D'CDULV Ti.'Oy L'tTI 
K \V r ')-'' X 'J/.. Ijt; SO'-OOL 
I'-'ON’TBa v , O.cLLn'’01\.i’ S.A Oil/Vj-iOOS 



I 



NAVAL POSTGRADUATE SCHOOL 

Monterey, California 




“T" I 1 5T” cy* 1 iyy 

1 H ELOlO 



FORMULATION AND ANALYSIS OF SOME 
COMBAT-LOGISTICS PROBLEMS 

by 

Abdul-Latif Rashid Al-Zayani 
September 1986 



Thesis Advisor: 



Donald P. Gaver 



Approved for public release; distribution is unlimited 



T230082 






i 



UNCLASSIFIED 

ECURlfY CLASSlPK^A'lON QP ThiS PAGT 



REPORT DOCUMENTaXTION PAGE 



a REPORT SECURITY CLASSIFICATION 

UNCLASSIFIED 



b RESTRICTIVE MARKINGS 



>a SECURITY CLASSIFICATION AUTHORITY 



!b DECLASSIFICATION /DOWNGRADING SCHEDULE 



3 DISTRIBUTION/ AVAILABILITY OF REPORT 

Approved for public release; 
Distribution is unlimited 



l PERFORMING ORGANIZATION REPORT NUM8ER(S) 



5 MONITORING ORGANIZATION REPORT NUM3ER(S) 



a NAME OF PERFORMING ORGANIZATION 

jlaval Postgraduate School 



6b OFFICE SYMBOL 
(If applicable) 

Code 55 



7a NAME OF MONITORING ORGANIZATION 

Naval Postgraduate School 



c ADDRESS (C/fy, Sfafe, and ZiPCode) 

lonterey, California 93943-5000 



7b ADDRESS (Ofy, Sfare, ind ZIP Code) 

Monterey, California 93943-5000 



3 NAME OF FUNDING /SPONSORING 
ORGANIZATION 



8b, OFFICE SVM80L 
(If applicable) 



9, PROCUREMENT INSTRUMENT IDENTIFICATION NUMBER 



ADDRESS (Ofy, State, and ZiPCode) 



10 SOURCE OF FUNDING NUMBERS 



PROGRAM 


PROJECT 


task 


WORK UNIT i 


ELEMENT NO 


NO 


NO 


ACCESSION NO 



TITLE (Include Security Classification) ^ 

FORMULATION AND ANALYSIS OF SOME COMBAT-LOGISTICS PROBLEMS 



PERSONAL AUTHOR(S) , , . . ^ 

Al-Zayani, Abdul-Latif R. 



a TYPE OF REPORT 

ctoral Dissertatic 



13b TIME COVERED 
HfROM TO 






COUNT 



supplementary notation 



COSATI CODES 


FIELD 


GROUP 


SUB-GROUP 















18 SUBJECT TERMS (Continue on reverse if necessary and identify by block number) 

Combat-Logistics Problems; Combat MarkoyProcess ; 
Multivariate Continuous-time Markov decision 



abstract (Conf/nue On reverse if necessary and identify by block number) 

Models are developed to study the readiness and subsequent combat 
erformance of an air-interceptor squadron facing sudden attack. These 
odels necessarily link combat with logistics. The models are mainly 
nalytical and not a Monte Carlo simulation, and can be used to indicate 
he optimal weapon system to be procured and to study the effect of peace- 
ime decisions on combat outcomes. The logistics models use the matrix- 
eometric approach to study the general multivariate repairman problem, 
ith the possibility of simultaneous component failures. A repairman 
ssignment problem is formulated and solved using a multivariate 
ontinuous- time Markov decision process. Surprise scenarios are analyzed 
nd represented explicitly. Air-to-air combat is modelled as a transient 
ultivariate continuous— time discrete— state Markov process. Diffusion 
heory is used to approximate the solutions. The reason for using 



O'STRIBUTION /AVAILABILITY OF ABSTRACT 
53 -JNCLASSIFIED/UNLIMITED □ SAME AS RPT □ DTiC USERS 


21 A8STRACT SECURITY CLASSIFICATION 

Unclassified 


. f.AME OF RESRQ^nl8LE INDIVIDUAL 

rof. Donald P. Gaver, Jr. 


22b TELEPHONE (/nc/uc/e Area Code) 

(408) 646-2605 


22c OFFTCE SYMBOL j 

Code 55Gv 



FORM 1473, 34 MAR 



83 APR edition may be used until exhausted 
All other e^tions are obsolete 



SECURITY CLASSIFICATION OF THIS PAGE 
UNCLASSIFIED 



UNCLASSIFIED 

security classification of this pace fWh«n D*«» EnltfO ) 



ns - SUBJECT TERMS - (CONTINUED) 

process; Matrix-Geometric; Operational Logistics; 
Repairman; Diffusion; Readiness 



#19 - ABSTRACT - (CONTINUED) 

diffusions is ease of interpretation and computational' 
economy. A comparison with simulation results shows 
that diffusion yields good approximations. Improvement 
to the diffusion approximation is provided by applying 
"large deviations" procedures. 



0 102- LF- 0 1 4- 6601 

2 UNCLASSIFIED 



security classification of this PAGErWhen Dmtm Entmfd ) 



Approved for public release; distribution is unlimited. 



Formulation and Analysis of Some 
Combat-Logistics Problems 

by 

Abdul-Latif Rashid Al-Zayani 
Major, Bahrain Defense Force 
M.S. Logistics Management, 

Air Force Institute of Technology, 1980 

Submitted in partial fulfillment of the 
requirements for the degree of 



DOCTOR OF PHILOSOPHY 
IN OPERATIONS RESEARCH 

from the 



NAVAL POSTGRADUATE SCHOOL 
September _iaB6 



ABSTRACT 



Models are developed to study the readiness and 
subsequent combat performance of an air-interceptor squadron 
facing sudden attack. These models necessarily link combat 
with logistics. The models are mainly analytical and not a 
Monte Carlo simulation, and can be used to indicate the 
optimal weapon system to be procured and to study the effect 
of peacetime decisions on combat outcomes. The logistics 
models use the matrix-geometric approach to study the 
general multivariate repairman problem, with the possibility 
of simultaneous component failures. A repairman assignment 
problem is formulated and solved using a multivariate 
continuous-time Markov decision process. Surprise scenarios 
are analyzed and represented explicitly. Air-to-air combat 
is modelled as a transient multivariate continuous-time 
discrete-state Markov process. Diffusion theory is used to 
approximate the solutions. The reason for using diffusions 
is ease of interpretation and computational economy. A 
comparison with simulation results shows that diffusion 
yields good approximations. Improvement to the diffusion 
approximation is provided by applying "large deviations" 
procedures . 
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I. 



INTRODUCTION 



A. GENERAL 

Defense decision makers face a difficult planning and 
management task: assuring that their peacetime decisions 

result in maximum effectiveness of their combat units in a 
wartime environment. It is apparent that the defense deci- 
sions made today have great impact on a nation's security in 
the future. 

Since the end of World War II, the primary emphasis of 
logistics modelling has been to minimize cost under peace- 
time conditions. This is a consequence of a long period of 
relatively universal peacetime conditions; the enormous cost 
of modern sophisticated weapon systems; the long lead times, 
from the procurement to actual deployment, of these systems; 
and the general reduction in defense budgets over the years 
(with the exception of the most recent historical period) . 

As a result, the logistics component of military resource 
requirements is becoming increasingly costly, with control 
loosely related to operational performance. Furthermore, it 
is highly vulnerable to military budget cutting (Drezner and 
Hillestad, 1982) . 

Defense decisions must be objectively oriented. Unin- 
structed and unaided intuition alone is insufficient. 

Models must be a part of the decision-making process. 
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Drezner and Hillestad (1982) point out that, as a result of 
economic emphasis, and lack of distinct relationships to the 
operational performance, models are constructed around 
peacetime efficiency, by considering systems and policies 
that are based on least-cost peacetime alternatives. Rich, 
Stanley and Anderson (1984) point out that logistics 
planning must now more directly and explicitly consider 
wartime threats and activities. In their words: 

The weapon system development community should develop 
analytical approaches and tools to evaluate trade-offs in 
operating concepts founded on alternative basing and sup- 
port arrangements. Moreover, a weapon system's support 
characteristics should receive increased emphasis and 
clearer articulation in the formal expression of system 
requirements in the design and development stage. That 
emphasis must be matched by a more concerted use of logis- 
tics capability assessment models during concept formula- 
tion and advanced development and by earlier testing and 
evaluation aimed at uncovering the correcting weapon sys- 
tem support characteristics that could limit the system's 
combat effectiveness. 

We endorse the above views, and believe that the models 
constructed and analyzed in this thesis provide a step in 
the indicated direction. 

The main objective of this thesis is to develop analyti- 
cal models that will assist in making decisions regarding 
the design or procurement and operation of a defensive 
weapon system. 

This thesis analyzes an air defense weapon system, in 
particular an air-interceptor squadron, and constructs 
combat-logistics models for its performance. In general 
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these models or their extensions can be applied to other 
types of weapon systems and warfare scenarios. 



B . BACKGROUND 

We start by describing the characteristics of the real 
problem facing the defender, sketching the main features we 
choose to model, and stating the decision problems we 
address in this thesis. 

The real problem as faced by the defender consists of 
the following components: 

(a) Threat : There exists the possibility that the enemy 

will carry out a hostile air attack against a small 
country (or region) with a single defending air base. 

(b) Air Defense System : In order to defend the country 

from a hostile air attack, the defender needs to de- 
sign (or procure) and operate an air defense system. 
The air defense system is to consist of an air- 
interceptor squadron, short-medium range surface-to- 
air missiles (SAM) , an early warning system, communi- 
cation command and control (C^) system, and an 
intelligence system. 

(c) Early Warning System : The early warning system con- 

sists of a long-range ground-based radar with identi- 
fication friendly or foe (IFF) capability. The 
system perhaps uses information obtained from an air- 
borne warning and control system (AWACS) operated by 
friendly forces. 

(d) Intelligence System : Intelligence information can be 

proyided by monitoring enemy moyements and deploy- 
ments, monitoring enemy military training actiyities 
and their military communications. Analysis of the 
information obtained proyides expectations about 
enemy intentions. 

(e) Logistics Systems : The logistics system consists of 

repair shops and a supply depot. Each repair shop is 
specialized in repairing a certain type of module, 
e.g., engine, radar, airframe, etc. Each shop is 
assigned a certain number of "repairmen." We use the 
term "repairmen" to stand for repair units; the 
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limitations on the units' capacity for work may 
actually be instrumentation, tools, or the availa- 
bility of spare parts. The supply depot is provided 
on base. 

The air interceptor squadron is assigned peacetime mis- 
sions, such as training and reconnaissance. The equipment 
on the interceptor is susceptible to failure during such 
(essential) operations. Thus some of the air-craft assigned 
to the squadron may not be available at a given moment. 

The logistics system is responsible for maintaining 
maximum aircraft readiness; the aircrew, the , and the 
early warning systems assist in causing maximum destruction 
to enemy bombers. Clearly, there is a need for models that 
are capable of answering questions concerning the 
effectiveness of new weapon systems in combat, and of 
analyzing the tradeoffs between the various components of 
the weapon system. The combat-logistics models presented 
here contribute to fulfilling this need. 

This research constructs and analyzes some combat- 
logistics models for the air-interceptor squadrons. The 
combat-logistics models integrate logistics models with 
combat models. 

The objectives of combat-logistics modelling are: 

(i) to determine the optimal weapon system: given a 

specific threat, what is the optimal weapon system 
to be procured in order to optimize a certain 
measure of effectiveness (MOE) in combat? This 
question is to be answered with consideration paid 
to budget, manpower and storage space limitations. 
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(ii) to provide an approach for evaluating the effects of 
changes in the logistics system (in non-combat 
periods) on the effectiveness of the weapon system 
(in combat periods). 



C . APPROACH 

The approach chosen for developing the combat-logistics 
model is: 

1. To analyze the aircraft squadron logistics system and 
construct analytical models to represent it. 

2. To model and analyze the effect of considering differ- 
ent surprise scenarios. 

3. To develop analytical air-to-air combat models that 
can represent the type of combat the squadron is ex- 
pected to undergo in case of enemy attack. 

4. To integrate the models constructed in (1) and (2) 
with the combat models constructed in (3) above, and 
use mathematical programming techniques to optimize 
the effectiveness of the squadron subject to antici- 
pated "real life” conditions and cost constraints. 



D. LITERATURE REVIEW 

Our interest is mainly in the analytical side of the 
general problem outlined, and we review some of the work 
that has been done on related problems. 

Multi-echelon inventory problems have recently received 
considerable attention by logistics analysts. This is 
because the multi-echelon problem captures many logistics 
factors such as; the effect of component shortages on 
weapon system availability, the stockage levels at the 
supply depot, repair capability, the existence of appropri- 
ate and reliable test equipment, manpower, and transporta- 
tion. Zangwill (1966) developed a deterministic model to 
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determine the optimal production schedule for a multi- 
product, multi-facility production and inventory problem. 
Sherbrooke (1968) took a major step in analyzing multi- 
echelon supply systems by developing the Multi-Echelon 
Technique for Recoverable I.tems Control (METRIC) , which is 
an analytical model of a base-depot supply system. The 
METRIC model assumes that the item demand is a stationary 
compound Poisson process with a mean value estimated by a 
Bayesian procedure. A failed item is repaired on base with 
probability g, or sent for depot repair with probability 1- 
g. If an item is sent for depot repair, the base gener- 
ates a resupply request on the depot. The model assumes no 
lateral resupply between bases. The model minimizes the 
expected backorders for any system investment, and computes 
the optimal redistribution of stock. 

Muckstadt (1973) extended the results of METRIC to 
incorporate a multi-indenture (subcomponents of components) 
relationship. Mod-METRIC computes both base and depot spare 
stock levels for all items and all indenture levels. 

A further extension of METRIC, which considers non- 
stationary demand processes, is the Dyna-METRIC model, see 
Hillestad (1982). For a description of Dyna-METRIC from a 
logistician's perspective, the reader is referred to Pyles 
(1984) . The Dyna-METRIC model assesses the contribution of 
the components' support processes to wartime aircraft 
availability and sortie rate. 
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Drezner and Hillestad (1982) point out that a raajor 
weakness of work in the logistics area for military applica- 
tions is the lack of consideration of the weapon system 
availability and capability. The use of backorder measures 
for determining stockage levels does not consider the 
importance of the various components of the weapon systems. 
Backorder measures are common in the METRIC family of 
models . 

We now mention several features of the maintenance 
activity that can be incorporated into our logistics models. 

One widely used method of increasing operational availa- 
bility is to cannibalize weapon systems, substituting good 
components from one downed aircraft to prevent another air- 
craft from becoming unavailable. However, this area has 
received little attention in the literature, although the 
situation of full instantaneous cannibalization was 
considered (see Fisher and Brennan (1986)). A pioneer work 
for modelling cannibalization is by Hirsch, Meisner and Boll 
(1968). The most recent work in this area is by Fisher and 
Brennan (1986) , where several cannibalization policies are 
compared using simulation. Our study includes consideration 
of cannibalization strategies. 

Logistics models are evolving toward the wartime support 
aspects of logistics but more relevant measures of military 
performance must be considered. Rich (1986) points out that 
we cannot be satisfied with such measures as aircraft 
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availability and sortie generation capability. Instead, we 
need to focus on measures of system output such as targets 
killed. The observation has helped motivate the research 
reported in this thesis. 

A problem that currently faces defense decision makers 
is the extensive specialization, and the resulting size, of 
the maintenance force. An F-16 wing, for example, includes 
1089 support personnel organized into 23 different special- 
ties; see Rich, Stanley and Anderson (1984). This situation 
leads to vulnerability of the forces being supported and 
stresses manpower resources. An alternative that decision 
makers usually consider is cross training of the maintenance 
personnel so that they become generalists, i.e., capable of 
repairing more than one type of system (e.g., propulsion 
system, hydraulic system, fuel system, etc.). This alterna- 
tive becomes more attractive as the technology evolves, and 
systems are designed to be more modular. Increasingly, 
repairs at the base level consist of fault detection and 
replacement of the faulty modules. The faulty modules are 
then sent to the depot for actual repair. 

Rich, Stanley and Anderson (1984) also point out that 
combat forces must be able to operate in forward areas with 
minimal support resources. This means streamlining the 
flightline workforce by training and using maintenance 
generalists . 
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If the above alternative is employed, then one of the 
major questions that will face the decision makers is: how 

to manage the maintenance force so that the air-interceptor 
squadron readiness is sustained at the maximum possible 
level? Chapter III of this thesis addresses this question 
by searching for an optimal repairmen assignment policy that 
maximizes the expected number of aircraft ready to engage in 
combat. We do this by formulating the problem as a 
multivariate-continuous-time Markovian decision process. 

Recently, Szarkowicz and Knowles (1985) considered the 
problem of determining optimal operating policies for an 
M/M/S queueing system. The system state is represented by a 
bivariate vector, the first component is the number of 
customers in the system, and the second component is the 
number of active servers. They used a continuous time 
Markov decision process formulation to obtain an optimal 
control policy for the number of active servers; the cost 
structure includes customer holding and server operating 
costs as well as a linear switching cost. 

The problem that Sparkowicz and Knowles analyzed differs 
from our problem, since we consider more than one type of 
item to be repaired, and we need to have an item of each 
type to be operational in order to have an operational 
aircra ft. 
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For more work related to this area, the reader is 
referred to Howard (1969) , Zuckerman (1986) , Jo (1984) , 
Crabill (1972) and Miller (1968a), (1968b) and (1969). 

To consider the effect of the logistics system and the 
allocation of fixed monetary resources to competing but 
interrelated demands (such as, spares, test equipment, 
personnel, etc.) on the combat outcome of the weapon system, 
we need to consider the combat process explicitly in the 
model . 

In order to keep the model analytically attractive, we 
chose to represent the logistics system at a lower level of 
detail than the METRIC family of models, and to introduce 
the combat model explicitly. The logistics model is there- 
fore relatively simple. It presents only the most dominant 
features of a combat-logistics process (i.e., the process 
that the weapon system undergoes in peace and wartime 
environments) . This research effort may be regarded as a 
prototype of a large family of more complete combat- 
logistics models. Taylor (1980) points out that a simple 
model may yield an understanding of important relations that 
are difficult to perceive in a more complex model, and such 
insights provide valuable guidance for higher-resolution 
computerized investigations. 

Since the combat model plays a role of the same 
importance as the logistics model, an entire chapter of this 
thesis is devoted to the combat model. In particular, our 
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approach is to provide efficient computational methods to 
obtain "exact" solutions to multivariate Markov models, 
supplementing these with approximate, easily comprehended 
approximations based on diffusions. 

Recently, Taylor (1983) presented a comprehensive 
treatise on Lanchester-type models for combat, i.e., 
differential-equation models of attrition in force-on-force 
combat operations in which both deterministic and stochastic 
models for combat are considered. Taylor (1983) states, 
"combat is anything but a deterministic process." Thus, in 
order to incorporate the random nature of combat into the 
model, the combat process must be represented by a stochas- 
tic process. Combat analysts tend to represent the combat 
process probabilistically by Markov processes; see for 
example, Taylor (1983) , Kimble (1970) , Clark (1969) , and 
Bhat (1984). 

The most recent work done in this area is by Karmeshu 
and Taiswal (1986) , where they incorporate the effects of 
environmental fluctuations by regarding the parameters of 
the problem as stochastic processes. 

Feigin, Pinkas, and Shinar (1984) proposed a simple 
Markov model for the analysis of many-on-many air combat. 

The model is a four variate-Markov process where the state 
variables are: the number of free blue planes, the number 

of free red planes, the number of pursuing blue planes, and 
the number of pursuing red planes. Their solution approach 
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was to construct and solve the forward Chapman-Kolmogorov 
equations . 

We choose to model the air-to-air combat process by 
generalizing the deterministic model so that some 
probability statements can be evaluated. This can be done 
by representing the combat process by a multivariate diffu- 
sion process. We find that the diffusion-combat models 
constructed in this thesis provide good approximations to 
the corresponding Markovian-combat model. For the 
definition, description and discussion of diffusion 
processes the reader is referred to Karlin and Taylor 
(1981) . For related work the reader should refer to the 
papers of Iglehart (1965), McNeil (1973), Schach and McNeil 
(1973), Gaver and Lehoczky (1975), (1977a), (1977b), 

(1977c), (1979), and Gaver and Jacobs (1985). 

E. ORGANIZATION OF THE THESIS 

This thesis models a problem that is complex and has 
many factors to be considered. Therefore, we choose to 
decompose the problem into components: a logistics problem, 

and a combat problem; we then analyze each one separately, 
build an analytical model for each, then integrate (or link) 
the various models to evaluate the system effectiveness, 
which is, in combat terms, some measure of "leakage" or 
survivorship of the attackers. Each chapter analyzes and 
develops a model for a specific subproblem. Chapter II 
models the general repair system. Chapter III studies and 
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models the repairman assignment problem, while Chapter IV 
studies and models the air-to-air combat problem. Chapter V 
provides the approach for linking the logistics model to the 
combat model. Figure (1.1) illustrates the general 
structure of the thesis. 

In the first part of Chapter II, we build a model of a 
simple logistics system. We assume that each aircraft re- 
quires a single module in order to be considered opera- 
tional. The problem is modelled as a birth-and-death 
process, and also as a closed migration process. A closed 
form solution for the limiting distribution is presented. 
This is a simplified version of the real problem; it serves 
as a starting point or feasibility study. 

The surprise phenomenon is then analyzed and classified 
as total or partial surprise. Depending on what type of 
surprise is considered, the squadron readiness probability 
distribution is then computed. A simple example is provided 
to illustrate the model. 

In the second part of Chapter II, we generalize the 
above model to represent a two-module logistics system; 
i.e., it is assumed that each aircraft requires two opera- 
tional modules (one of each type) in order for it to be 
considered operational. We find that a simultaneous failure 
mechanism must be introduced in order to have a realistic 
representation. A simultaneous failure mechanism means that 
the conditional probability of an aircraft failure due to 
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LOGISTICS MODELS 



Operational Logistics 
(Chapter II) 

** Single module logis- 
tics ( IML) . Aircraft 
needs single module to 
be considered 
operational . 

Two module logistics 
(2ML) . Aircraft re- 
quires 2 types of 
modules (one of each) 
to be considered 
operational . 

Surprise : 

* Full surprise 

* Partial surprise 



** 



* * 



Repairmen allocation 
problem (Chapter III) 
** Linear Programming 
** Dynamic Programming 



COMBAT MODELS 
(Chapter IV) 
Deterministic 
Diffusion 
Markovian 
Simulation 
Large Deviations 




COMBAT-LOGISTICS MODELS (Chapter V) 

* Single-module-combat-logistics: 
Integrates IML with a combat model . 

* Two-module-combat-logistics: 
Integrates 2ML with a combat model . 



Figure 1.1. Structure of the Thesis 
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both modules failing is positive. The problem is formulated 
as a bivariate birth-and-death process. To simplify the 
computations the problem is then formulated so that it can 
be presented in a matrix-geometric form. This is done by 
adopting the arguments in Gani and Purdue (1984) and in 
Gaver, Jacobs and Latouche (1984). For an explanation of 
the matrix-geometric formulation the reader is referred to 
Neuts (1981). The squadron readiness probability distribu- 
tion for the two-module logistics system is then presented 
for both types of surprise. This is followed by a simple 
example to illustrate the technique. 

In Chapter III, we hypothesize an operational logistics 
scenario. The problem is a repairmen allocation problem, 
where the repairmen are assumed to be general technicians 
capable of repairing both types of modules. The mainte- 
nance supervisor is interested in finding the optimal repair 
policy that maximizes the squadron readiness. The problem 
is formulated as a bivariate-continuous-time-Markov-decision 
process. A one-to-one transformation of a multivariate- 
Markov process to a univariate-Markov process is presented. 
The transformation allows us to use the existing theory and 
techniques for the univariate-Markov decision process to 
solve a multivariate one. The problem is then solved by 
dynamic programming and linear programming approaches. An 
example to illustrate both approaches is given, followed by 
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a comparison and evaluation of the results of both 
approaches . 

In Chapter IV we discuss the characteristics of the air- 
to-air combat and provide the following air-to-air combat 
scenarios to be modelled: 

(i) BCD Scenario : Both defenders and enemy bombers are 

assumed to be vulnerable, and defenders spend some 
time searching for a free enemy bomber. Once a free 
enemy bomber is detected, it is then engaged by a 
free defender. The one-to-one engagement is assumed 
to continue until either a bomber or a defender is 
killed. If the bomber is killed the defender once 
again searches for a free bomber; the process 
continues. 

(ii) I Scenario : This scenario assumes that the 

defenders are invulnerable. Only one free defender 
can engage a free bomber, and the engagement is 
assumed to be instantaneous; i.e., once a defender 
becomes free, no time is spent searching for a free 
bomber if one is available (perfect C^ system) . 

This is the simplest situation; it is characterized 
by a one-dimensional Markov chain. 

Both of the above scenarios implicitly assume that the 
enemy bombers arrive in combat simultaneously. 

In the second part of Chapter IV, we construct and 
analyze deterministic models for the above two scenarios. 
Next we generalize the deterministic models by developing 
diffusion models to represent the air-to-air combat. Simple 
continuous-time discrete-state Markov models are then 
constructed to represent the combat processes for the above 
scenarios; the latter models are referred to as Markovian- 
Combat models (of course the diffusions are an approximation 
to these, and are themselves Markovian; the reason for using 
diffusions is ease of interpretation and computational 
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simplicity) . The forward Chapman-Kolmogorov equations for 
these models are derived, as are their Laplace transforms. 
Techniques for solving the Laplace transforms are presented. 

In order to evaluate and compare the different 
approaches, the Markovian combat process for the BCD 
scenario is simulated. A large deviations equation for the 
MOE, under the I scenario, is derived; for the large 
deviations approach see Feller (1971), and for applications 
see Mazumdar and Gaver (1984). 

Finally we present in Chapter IV some illustrations to 
compare and analyze the combat models. 

In Chapter V we study the entire combat-logistics 
situation that confronts the decision maker. We then 
present the model's basic concept and assumptions. The 
problem is then formulated as a non-linear-integer mathe- 
matical programming model. 

We first examine the single-module combat logistics 
(IMCL) model which is a result of linking the single-module 
logistics model to a combat model, subject to budget and 
operational constraints. The two-module combat logistics 
(2MCL) model is next constructed as a generalization for 
IMCL. 

By way of illustration we present some examples for IMCL 
and 2MCL models using both the BCD and the I scenarios. 

Some sensitivity analysis on the combat and logistics 
parameters are also conducted. 
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We close our discussion in Chapter VI with a review of 
the results obtained and their implications, and some 
concluding remarks and recommendations for further research. 

Two appendices are included to describe additional but 
somewhat peripheral research related to the main emphasis of 
the thesis. 

Appendix A contains a discussion of the large deviations 
technique. A large deviations equation for fixed, and 
randomized, sums of independent and identically distributed 
random variables is presented, followed by applications to 
compound Poisson process and renewal processes. The 
techniques have application to classical inventory control 
problems. A proposed approach to minimize the large devia- 
tions error is introduced, followed by an illustration of 
the approach applied to the compound Poisson process. 

In Appendix B, we generalize Lanchester's linear law by 
developing a diffusion model. A simple continuous-time 
discrete-state Markov model is then constructed to represent 
the corresponding combat process. 
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II . 



OPERATIONAL LOGISTICS MODELS 



A. INTRODUCTION 

This chapter formulates and analyzes some operational 
logistics problems. Logistics is an area that gives rise to 
classical operational research problems which suggests that a 
considerable body of work has been done in this area. Never- 
theless, the linkage between combat models and logistics is 
a research area that is ripe for further research. Particular 
attention in this thesis has been directed towards the repair- 
man problem. Feller (1971) defines the repairman problem, and 
Kelley (1979) provides a closed product-form solution for the 
single type module repairman problem. This chapter formulates 
and solves a multivariate repairman problem with simultaneous 

failure and consequent simultaneous demand for several resources. 

Gaver and Lehoscky (1976) formulated and analyzed a 2-module 
repairman problem, wherein there was a number, a, of aircraft, 
each requiring both types of modules, one of each, to operate. 
When an aircraft fails it has conditional probabilities p^^ , 
and Pj ^2 being down due to a failure of Type 1, Type 2, or 
both types of modules, respectively, where Pj^ + P 2 + P]^2 ~ 

This model assumed that an aircraft will be in repair until 
the failed modules were repaired (i.e., the assumption indi- 
cates that there were no spare modules assigned to the organi- 
zation) . The problem was modelled as a diffusion process which 
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Figure 3 . 9 . The Infinitesimal Generator for the Repair Process 
with R, = 3 and R« = 0 
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Figure 3.8. The Infinitesimal Generator for the Repair Process 
with R, = 2 and R„ = 1 
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Figure 3.7. The Infinitesimal Generator for the Repair Process 
with Rt = 1 and R„ = 2 
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Figure 3.6. The Infinitesimal Generator for the Repair Process 
with R, = 0 and R„ = 3 
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Figure 3.5. An Illustration of Transition Flow as a Function 
of Decision Taken at Each State 



The total number of Type 1 and Type 2 modules available 
in the squadron are 2 and 3, respectively (i.e.. 

Ml = 2, M 2 = 3) 

The maintenance commander is assigned 3 repairmen, 
and every repairman is capable of repairing both 
modules . 

An aircraft is reported down with a rate X = 1 aircraft 
per day. 

The probabilities of an aircraft down due to module 
failures of Type 1, Type 2 or both Types are = ,4, 

?2 = .5, “ •! respectively. 

Modules of Type 1 and Type 2 are repaired with rates 
= .5 and ^2 ~ ^ modules per day. 

A FORTRAN program has been written to compute the infini- 
tesimal generator matrices, and create the output format 
suitable for optimality analysis. The linear programming 
was implemented using the LINDO interactive package. A 
FORTRAN program to implement the dynamic programming approach 
was written using the policy improvement technique. Appendix C 
presents the computer listings for the programs. 

The graph of the above system is shown in Figure (3.5) 
where the repair rates are functions of the decision. The 
inf initesim.al generators for y = 0,1, 2, 3 are illustrated 

in Figures (3.6), (3.7), (3.8) and (3.9) respectively. The 

infinitesimal generators Q for any policy can now be calcu- 
lated using the infinitesimal generators Q^, y = 0,1, 2,3. 

This is done by picking the necessary rows from the four 
matrices. For example, suppose the infinitesimal generator 
for the policy 



r= (1 22032102222) = (y(n)) 
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f(n) + 



(3.19) 



g (n) 



{M^ + D (M2 + I) 

1 q(n,m)Vj^ 

m=l 



The set of equations (3.19) consists of (M^^+l ) (M 2 + I ) equations 

with (M^+1) (M 2 +I) +1 unknowns ( (M^+1 ) (M 2 +I ) ' s and 1 g) . 

Therefore set V-., , t > . = 0 and solve for the rest. 

(M^+1) (M 2 +I) 

Thus, for a given policy we can find the gain and the 
relative values of that policy by solving the (M^^+l) (M 2 +I) 
linear equations simultaneously with ^ .,. 1 ) (jyj + 1 ) “ • 

The Policy-Improvement routine is then used to find a 
policy that has higher gain than the original policy. 



(Mj^+1) (M 2 + I) 

Max f (n) + I q (n,m) 

Y m=l ^ 



The optimal y will be the decision to be taken when in 
state n; hence, a new policy has been developed. The proce- 
dure is then repeated until g is maximized, i.e., when the 
policies on 2 successive iterations are identical. 

J. MODEL ILLUSTRATION 

The following basic data were used as an example: 

An aircraft requires 2 types of modules (e.g., engines 
and communications) to be operational. Modules of Type 
1 are engines and modules of Type 2 are communications 
equipment . 

- The squadron is assigned exactly 2 aircraft. 
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The set of equations (3.16) is a matrix representation 
of equations (3.15). The equations are a set of linear, 
constant-coefficient differential equations that relate the 
total reward in time t from a start in state n to the quanti- 
ties f (n) and q(n,m). But for large t (Howard, 1969) 

V^(t) = tg^ + n = 1, . . . , (Mj^+1) (M 2 +I) 

Therefore : 



g 



n 



dV (t) 
n 

dt 



Using equation (3.15) we obtain: 



(M^+1) (M 2 +I) 

^n " ^ q(n,m) (tg^^+Vj^) 

m=l 

(M^+1) (M 2 +I) (M^+1) (M 2 +I) 

g^^ = f(n) + t I g(n,m)g^^ + I g(n,m)Vj^ 



For equation (3.17) to hold for all large t, we must have: 



(M^+1) (M 2 +I) 

'l q(n,m)gj^ = 0 (3.18) 

m=l 



and 
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Vj^(t+dt) = (1+q (n ,nj dt) [f (n) dt+V^ (t ) ] 

+ y q(n,m)dtV (t) + o(dt) 

Subtracting V^(t) from both sides and dividing by dt, the 
above equation becomes : 

V (t+dt)-V (t) 

= f(n) + q(n,n)f(n)dt + q(n,n)V^(t) 

+ I q(n,m)V^(t) 
n^m 

Let dt -> 0 ; the above equation becomes: 




(M^+1) (M 2 +I) 

f(n) + I q(n,m)V^(t) 



( 3 . 15 ) 



n = 1 



(M2+I) 



Changing to vector notation, this becomes: 




F + Q V(t) 



( 3 . 16 ) 



where : 



^(Mj^ + 1) (M2+I) ^ 



[f (1) 



/ • • • f 



f (Mj^ + l) (M 2 + I) ] 



Q = infinitesimal generator. 
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Figure 3.4. Iteration Cycle Schematic (Howard, 1969) 
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The optimal policy can be found using the policy-iteration 
method which consists of the value-determination operation and 
the policy- improvement operation. Both operations can be 
used recursively as shown in Figure (3.4), until the optimal 
policy is found. 



Let : 




Total expected reward the system will 
earn in a time t if it starts in state 

n . 



V^(t+dt) can be related to by considering the 

following transitions and rewards. 



n 



t 



t+dt 



n 



f (n) dt+Vj^ (t) 



reward 



probability 
1 - I q(n,m)dt 



n^^m 



(m^n) 




q(n,m)dt Vm^^n 



Therefore , 



V^(t+dt) 



(1 - I q(n,m)dt) [f (n)dt +V (t) ] 
n^m 



+ I q(n,m)dtV (t) + o (dt) 
n^m 



But, 



q (n ,n) 



I q(n,m) 
n^m 
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q(n,m) = rate of transition from state n to 
state m. 

r(n,m) = reward associated with the transition 
from n to m. 

Since there is no reward gained by transitioning from 
state n to state m, r(n,m) = 0 for n ^ m, and h(n) = r(n,n). 
Hence, for the repair scheduling problem: 

(M^+1) (M 2 +I) 

g = I (3.14) 

n=l " 



where : 



f (n) 



min{a,M^- 



n 

VI 




,M2~n + 



n 

M2+1 




(Mj + D+l} 



since at each state a decision has to be chosen from a 
number of decisions, therefore it can be thought of as having 
several Markov processes, and the objective is to know which 
one yields the highest expected number of aircraft operational, 
in the long run. 

It is possible to describe the policy by a decision vector 
r whose elements represent the number of the decision selected 
in each state; i.e., the i^^ element of the vector 1 indicates 
the number of repairmen to be assigned to Shop 1 whenever 
the process is in state i. 

An optimal policy is defined to be the policy that maxi- 
mizes the gain, or average return per transition. 
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Number of constraints 



3112 constraints. 



Therefore the 'practical' problems tend to be large 
under this formulation. 

I. DYNAMIC PROGRAMMING APPROACH 

The f inite-state-continuous-time-Markov process being 
analyzed has been shown to have a limiting distribution. 
Therefore, the policy-iteration method for the solution of 
the sequential decision process, developed by R. Howard 
(Howard, 1969), can be used. 

Howard states that every completely ergodic Markov process 
with rewards will have a gain, g, given by: 



N 



g 



I IT h(n) 
n=l ^ 



(3.12) 



where : 



N 



number of states 



TT 



n 



limiting probability of being in state n 



h(n) = expected immediate return in state n defined 
by : 



h(n) = r(n,n) + J q(n,m)r(n,m) 



(3.13) 



mf^n 

n = 1 , 2 , . . . , N 



/ • • * / 



where : 
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y. This observation (Ross, 1983), allows us to solve the 
linear program, and the solution will always have y as either 
0 or 1 . 

The above formulated linear programming problem has 
(Mj^+1) (M 2 + 1)+1 = Mj^M 2 + + M 2 + 2 functional constraints. 

Since the infinitesimal generator Q is of rank M^M2+M^+M2+1 , 
there is a constraint that is linearly dependent on the other 
constraints. Hence the problem has a single redundant con- 
straint, and the number of constraints in the L-P can be 
reduced at no loss by dropping one of the constraints (ii) ' 

I 

in the L-P. ' 

The L-P can be solved by the simplex method, and its solu- 
tion has some interesting properties (Ross, 1983). The solution 
will contain (M^+1) (M 2 +I) = Mj^M2+Mj^+M 2+1 basic variables 
-fTj^(Y) ^ 0. Since the repair policy was assumed to be sta- 
tionary, the policy is deterministic , meaning that one and 
only one decision will be chosen each time the process enters 
any given state. It follows that only one tt^(y*) > 0, while 
the = 0 for y = 0,1,..., R, y y* . Since the Markov 

process is irreducible and since every state is positive 
recurrent, it follows that tIj^(y*) > 0 for n = 1 , 2 , . . . , (M^^ + l ) (M 2 +] 
Therefore, > 0 for exactly one y = 0,1,..., R, for each 

n = 1,2,..., (Mj^ + l) (M 2 + 1) . 

The L-P has (R+1) (M^^+1) (M 2 +I) decision variables. Suppose 
that the problem at hand has M^^ = 50, M 2 = 60, R = 20. Then: 

Number of decision variables = (21) (51) (61) = 65,331 variables. 
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TT*(y)/ Y = 0,1, n = 1 , 2 , . . . , (M^^+1 ) (M 2 + I ) , that 
maximizes the objective function and satisfies the constraints 
is the solution for the following linear programming model: 



LP 



(M^+1) (M 2 +I) p 

max I I f{n)ir (y) 

IT n=l Y=0 



subject to: 



(i) 



(M^+1) (M 2 +I) 



I 

n=l 



1 TT^(Y) 
Y=0 



= 1 



{M^+1){M2+D p, 

(ii) I I tt (Y)q (n,m) 

n=l Y=0 ^ 



= 0 



m 



= 1,2, ... , (M^ + 1) {M 2 +I) 



(iii) ^ "Y = 0,1,2, ...,R 

n = 1,2, ... , (Mj^+1) (M 2 +I) 

Since the objective function is a linear function of the 
decision variable tt^Cy); ^nd the constraints form a set of 
linear equations, the above problem is a linear programming 
problem. Note that, even though f (n) (f (n) = min{a ,Mj^-i ,M 2 ~ j } ) 
is a nonlinear function of i and j , it is not a function of 

The value of fTj^(Y) will dictate the value of y, where 
if tTj^(y) > 0 then the decision to be taken when in state n is 
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t h 

where: q(n,m) is the (n,m) element of the matrix Q, the 

infinitesimal generator of the Markov Process; i.e., q(n,m) 
is thought of as the rate from state n to state m. Therefore 
iTn(Y) must satisfy the following linear relations: 



(M^+1) (M 2 +I) ^ 



I 

n=l 



I = 1 



Y = 0 



(M^+1) (M 2 + I) 



2 . 



z 

n=l 



I 7T (Y)q (n,m) 
Y = 0 ^ 



= 0 m= 1,2,..., (M^+1) {M 2 



and 



3. tt^(y) >0 Y = 0,1,2,. ..,R n = 1 , 0 , 2 , . . . , (M^ +1 ) (M^+1 ) 



The long run expected number of aircraft that are opera- 
tional is given by: 



(M^+1) (M^+l) 

E [Number of aircraft operational] = 1 f(n)iT^ 

n=l 



(M^+1) (M 2 +I) 

I 

n=l 



Y=0 



f (n) TT (y) 



Therefore the objective function is given by: 



maximize 



(M^+1) (M 2 +I) 

I 

n=l 



R 

I f(n)TT (Y) . 

Y=0 
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Therefore , 



7T (y) = IT . . (y ) 

n 1 / J 



(3.10) 



where : 



7T (y) = P{ state = n and decision = v) • 

n 

These limiting probabilities were obtained from equations 
(3.6) and (3.8). 

From the law of total probability, we get: 



P{state = (i,j)} = J P{state = (i,j) and decision = y) 



= z 

Y 



(3.11) 



Since it is a lim.iting distribution, then it is the 
n ^ n 

unique solution for the following system of linear equations 



(M^+1) (M^+l) 
n=l 



7T =1 
n 



(M^+1) (M 2 +I) 

2. I 

n=l 



iT^q(n,m) = 0 



m= 1 , 2 ,...,(Mj^+ 1 )(M 2 + 1 ) 
(the forward equations) 



and 



3 . TT >0 
n — 



n = 1,2,..., (Mj^+1 ) (M^+l ) 
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Figure 3.3. The Transitions Flow for State (i,j) 
for any Repair Policy 
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Figure 3.2. Transition Flow for the 
Failure-Repair Process 
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1,2M +2 




be the total repair rate when the process is 
in state n for Shop 1. 

the total repair rate when the process is 
in state n for Shop 2 . 



Therefore : 



= A f(n) 

rain (y (n) , i) 

^2n ^ ^2 (n) , j ) 

where : 



f (n) = min{a,M^-i,M 2 ~j } 

i and j are given by equations (3.6) and (3.8). 

Figure (3.2) shows the corresponding transition graph 
for the process {Y(t),t ^ 0}. The transition for any state 
(i,j) is shown in Figure (3.3) for any repair policy. 

H. LINEAR PROGRAMMING APPROACH 

Let TT^ j ^ unconditional limiting probability that 

the system is in state (i,j) and decision y is made, that 
is : 



7T. . (y ) = P{state = (i,j) and decision = y} , 

1/1 
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operating on the state space { 1 , 2 , . . . , (M^^ + l ) (M 2 +I ) } . Hence, 

if Y(t) = n then Xj^(t) = i, ^2 (t) = j where i,j are given 

by equations (3.6) and (3.8) respectively. 

Let P (t) = p{Y(t) = n|Y(0) = ml 
m / n 

= P{X^(t) = i,X2(t) = jlx^(O) = iQ,X2(0) = 



where : 



m 

M2 + I 



- 1 



jo = m - io(M2 + l) - 1 



i,j are given by Equations (3.6) and (3.8). 

Let TT = lim P (t) 
n m,n 

= lim P{X^(t) = i,X 2 (t) = j|X^(0) = io,X2(0) = jol • 

t~>oo 

Using equations (3.3) to (3.5), the following was obtained: 



Since tt . . was shown to exist and is positive, therefore 

1/3 

it was concluded that will exist and is strictly positive 

(i.e. , 0 < TT < 1) . 
n 

Let : 



A be the total failure rate when the process is in 
state n. 
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1 



4 




- i^(M2 + l) (M3+I) (M^ + l)-i2 (M3 + I) (M^ + l)-i3 (M^ + D-l 



= n-i^ (M2+I) (M3+I) (M^+ 1 ) (M3+I) -i2 (M3+I) (M^+l) (M3+I) 

- 13 (M^+ 1 ) (M3+I) - i^(M3+l) - 1 

Various examples carried out for the various cases and 
the above equations were found to give the correct corres- 
pondence between the set N and the corresponding state space 

S. 

Therefore, it could be concluded that the set of equations 
( 3 . 9 ) allow us to transform a K-dimensional-continuous-time 
Markov process operating on a finite discrete state space 
to a univariate-continuous-time Markov process operating on 



the analyst to carry out all necessary analysis on the uni- 
variate-continuous-time-Markov process, using all existing 
theorems and algorithms for the univariate process, and 
then retransforming the results back to the K-dimensional 
process using again the set of equations ( 3 . 9 ) . 

As shown above, in the case of bivariate Markov process, 
knov/ing n, the corresponding state (i,j) can be determined 
and vice versa, i.e., if (i,j) is known, then n can be 
determined. With such observations the bivariate continuous- 
time-Markov- process can be transformed into a univariate- 
continuous-time-Markov-process . Define the stochastic 
process {Y(t),t ^ 0 } to be a continuous-time-Markov process 



the finite state space N = { 1,2 



f m m • f 



j = l 



K 

n (M.+l)}. This allows 
= 1 3 
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i 2 (M 3 +l) - 1 



= n - (M2+I) (M^+l) - 



For K = 



n = 






4 : 

(M2+I) (M^ + l) (M^+ 1 ) + i2 (M^+l) (M^+ 1 ) + i2(M^+l) + 14+1 



(M2+I) (M3+I) (M4+I) 

■(M 3 +I) (M 4 +I) " ^ 

- i^(M2+l)(M3+l) - i2(M3+l) - 1 

n - (M2+I) (M3 + I) (M4 + I) - ±2 (M3+I) (M^+ 1 ) 

- i 3 (M^+l) - 1 



For K = 



n = 



5 



i 



^ (M2 + I) (M3+I) (M4+I) (M5+I) + ±2 (M3+I) (M4+I) (M3+I) 

+ 13 (M4+I) (M5+I) + i4(M3+l) + ±3 + 1 

^ D - i 1 

(M2+I) (M3+I) (M^+l) (M3+I) 

(M3+I) (M4+I) (M3+I) " 11(^2+!) - 1 



n 

(M^+ 1 ) (M3+I) 



- (M2+I) (M3+I) - i2(M3+l) - 1 
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n (M.+i) 

j = 2 3 



m 



n 

K 

n (M.+i) 
j=m+l ^ 



m-1 m 

I i n (M +D-1 
1=1 j=£+l J 



2 < m < K-1 



(3.9) 






K-1 K 

n- 1 i. n (M.+l)-l 
j=l ^ £=j+l 



Considering different values for K, we get the following 
equations : 

For K = 2 : 



n = 



For K = 3: 



il(M2+l) + i2 + 1 

“ 0 i“ 

(M2+I) 

n - ij^(M 2 +l) - 1 



n = ij^(M 2 + l) (M^+l) + i 2 ( 1 ^ 2 + 1 ) + i^ + 1 



^1 = 



n 



(M 2 +I) (M^+l) 



- 1 



n 



^2 ( Ko + 1 ) ■" 1'"'2 



- ii (FU+l) -1 
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n = i (M 2 + I) (M^ + l) + jdyi^ + l) + k + 1 

Thus, the trivariate Markov process X(t), operating on 
the state space S, can be transformed into the univariate 
Markov process {Y(t),t ^ 0} operating on the state space N 
by using the following equations: 



n = i (M 2 +I) (M^+l) + j(M 2 +l) + k + 1 



1 = 



n 



(M 2 +I) (M^+l) 



- 1 



J = 



n 



Mo+1 i 0^2+1) 1 



k = n - i (M-+1) (M,+l) - j(M^+l) - 1 



Various trial runs have been conducted on the above 

equations for both bivariate and trivariate Markov processes 

and found to be correct. This shows that a generalization 
th 

for a K variate-Markov process is possible, as shown below 

th 

Consider a K -variate-continuous-time-Markov process 

X(t) = {X^ (t) ,X 2 (t) , . . . ,Xj^(t) ;t ^ 0} operating on the state 

space S = { (i, , i« , . . . , i, ) ; i . = 0,...,M.,j = 1,...,K}. The 

cardinality of the state space is II (M.+l). 

j = l ^ 

K 

Let N = {1,2,..., n (M.+l)}. Let n e N. Then: 

j = l => 



K-1 K 

n = I i. n (M.+l) + i^ + 1 



j = l -> £=j+l 
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Therefore, if n is known, then i must satisfy 



n 



(M2+I) (M^+l) 



- 1 < i < 



n 



(M2+I) (M3+I) 



Using the same argument used for the bivariate case we 
find that: 



1 = 



n 



(M2+I) (M^+l) 



- 1 



Now, knowing both i and n, we need to determine j. 
If i = 0 , then: 



If 



n £ (M3+I) 



then j = 0 



If (M^+l) ^ £ 2(M3+1) then j = 1 



If n2(M3+l) < £ (n2 + l) (M^+l) then j = n2 



Hence: If i = 0 then j = 



n 



(M3+I) 



- 1 



If i = 1 , then: 



If (M2+I) (M^+l) < n £ [ (M2+I) + 1 ] (M3+I) then j = 

If [(M2+l)+n2l (M^+l) < n £ [ (M2+I ) +U2+1 ] (M3+I) then j 



Hence: If i = 1 , then j = 

Therefore : 



n 



M. + l ■ ^ 



3 = 



n 
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TABLE 3 . 1 



THE CORRESPONDENCE BETWEEN N AND (I,J) 
USING EQUATIONS (3-6) AND (3.8) 



n i = 


r ^ 1 


j = n - i (M 2 +I ) - 1 


+1 


1 


0 


0 


2 


0 


1 


3 


0 


2 


4 


0 


3 


5 


1 


0 


6 


1 


1 


7 


1 


2 


8 


1 


3 


9 


2 


0 


10 


2 


1 


11 


2 


2 


12 


2 


3 



j = 0, . . . ,M 2 ,*k = 0, . . . ,M^} . Let N = {1,2, , (M^^ + l) (M2+I) (M^+D > • 

Let n e N, then we need to determine (i,j,k). 



If n £ (M 2 +I) (M^+l) then i = 0 

If (M2+I) (M^+l) < n £ 2 (M2+I) (M^+l) then i = 1 

If n^ (M2+I) (M^+l) < n £ (n^^ + l) (M2+I) (M^+l) then i = 
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n 



(3.7) 



= i(M2+l) + j + 1 

j = n-i(M2+l) - 1 (3.8) 

To illustrate the above, consider the case where = 2 
and M 2 = 3 . A graph of the state space is shown in Figure 
(3.1), where each state is numbered by n and the corresponding 
(i,j) values. Table (3.1) shows the correspondence between 
n and (i,j) computed using equations (3.6) and (3.8). Examina- 
tion of the table shows clearly the usefulness of equations 
(3.6) and (3.8). 




Figure 3.1. A Correspondence Between n and (i,j) 

To generalize the above mapping, we derive equations 
similar to equations (3.6) and (3.8) for the case of a 
trivariate-continuous-time Markov process. 

Consider a Markov process X(t) = (t) ,X 2 (t) , (t) ; t ^ 0} 

operating on a state space S = {(i,j,k): i = 0,...,Mj^, 
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1 



2 



and if 2 (M 2 + 1 ) < n £ 3(M2+1) then 
Hence, if nj^(M 2 +l) < n £ (n^ + 1) (M 2 +I) then i = 

The general form is 

i(M2+l) < n (i+1) (M 2 +I) 

Therefore, if n is known, then i must satisfy: 



n 

«2 +1 



- 1 < i < 



n 

M2 +1 



Note that i must be integer. Therefore: if 



n 



is integer, then i 
M 2 + 1 ^ ' 



n 



«2 +1 



- 1 



n 



Suppose that - — -pp is not integer, then: 
JVI2 +1 



n 



M 2 ti 



- 1 



< 1 < 



n 



«2 



where pTj is defined to the smallest integer ^ X, and 
the largest integer < X. But, 



n 



M2 +1 



- 1 



n 



«2 +1 



-1 



n 



«2 +1 



Therefore , 



1 = 



n 



M2 -fi 



- 1 



Lxj 



( 3 . 6 ) 
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Let S be the collection of all possible states for the 



process { ( t ) , X 2 ( t ) ; t ^ 0}. 

S = {(i,j): i = 0,1, = 0,1,...,M2> . 

The cardinality of the set.S is (M^^+l) (M 2 + I) . When the process 
is in state (i,j), there are f(i,j) = min{a ,M^-i ,M 2 ~ j } 
operational aircraft. Therefore the commander's objective 
stated mathematically is : 

max I f(i,j)TT. . 

all Y (i, j) (i, j) eS 

where y(i/j) is the action taken whenever the process is in 
state (i , j ) . 

To compute the optimal repair policy, two optimization 
approaches will be used, linear programming and dynamic 
programming . 

To simplify the notation, it may be observed that a 
one-to-one mapping between the set N = { 1 , 2 , . . . , (M^^+l ) (M 2 +I ) } 
and the set S can be defined. Figure (3.1) shows a corres- 
pondence between N and S. Let n e N, and (i,j) e S. We 
need to determine the values of i and j if n is known. We 
note that, 

if n £ M 2 +I then i = 0 
and if M 2 +I < n ^ 2 (M 2 +I) then i = 1 
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All policies to be considered are stationary policies. That 
is, whenever the process is in state (i,j), the decision to 
be made is the same for all values of t. 

The objective of the maintenance commander is to maximize 
the squadron readiness, which will be measured, as stated 
before, by the expected number of operational aircraft . 
Alternative measures are possible, and may even be more appro- 
priate. To obtain a mathematical expression for the commander's 
objective, define the following: 



Pnm,ij(t) = P{Xj^(t) = i,X 2 (t) = j|Xj^(0) = n,X2(0) = m} (3.3) 

Let P..(t) =P . . (t) , then (3.4) 

1 ] nm, 1 ] ' 

7T. . = lim P. . (t) (3.5) 

i.e., ir^ j is the limiting probability of observing the 
system to be in state (i,j). 

All states of the Markov process defined by (3.2) com- 
municate, so the Markov process is irreducible. Hence the 
limiting distribution exists and is independent of the initial 
condition. Since every state is a positive recurrent 
state, the limiting probabilities ^ are all positive 

and form a probability distribution; (i.e., ir . > 0) . 

1/1 
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If Shop 1, where repair of Type 1 module is conducted, 
has repairmen assigned, where 0 _< £ R, then the transi- 

tion probabilities are, to terms of order dt; 



t 




t+dt 


Probability 




(i/ j ) 




(i+1 , j ) 




min{a ,Mj^-i ,M 2 ~ j 


}dt 






(i, j+1) 




min{a,Mj^-i ,M 2 ~j 


}dt 




-> 


( i+1 , j +1 ) 


^12^ 


min{a ,Mj^-i ,M 2 ~ j 


}dt 




-> 


(i-1, j) 


^1 


min{ Rj^ , i }dt 






-> 


(i, j-1) 


^2 


min{R-Rj^ / j }dt 





The above assumptions and formulation specify the sto- 
chastic process (t) ,X 2 (t ) , t £ 0} as a bivariate Markov 
birth-and-death process. The limiting probability exists 
and can be found by solving a system of linear equations. 

G. DECISION MODEL FORMULATION; A REPAIR POLICY 

A repair policy is a rule for making decisions after 
observing the system. The policies that are considered in 
this study are the type of policies that depend only upon the 
observed state of the system at time t, {X^^ (t ) ,X 2 ( t ) } , and 
the possible decisions available, where decisions can only 
be taken when the state of the system changes. Therefore 
each policy can be completely characterized by a vector that 
prescribes the decision to be taken when the system is in 
state (i,j), i = 0,1,..., M^^; j = 0,1,..., M 2 . The components 
of such a vector represent the number of repairmen to be 
assigned to Shop Type 1 when the system is in state (i,j). 
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F. PROBLEM FORMULATION 

Consider an aircraft squadron that consists of a number, 
a, of failure-prone aircraft each susceptible to failure from 
one or both of two causes. Let A denote the overall Markovian 
failure rate of an individual aircraft, and let denote the 
conditional probability that a failure requires just Type 1 
(e.g., engine) repair, P 2 the conditional probability that the 
failure is of Type 2 (e.g., communications) and P ^2 the condi- 
tional probability that both Type-1 and Type -2 failures occur. 
Thus, P 2 + P ^2 ~ the sequence of successive failure 

types is one of independently and identically distributed 
random variables. Suppose that there are M^^ and M 2 modules of 
Type 1 and Type 2 respectively, assigned to the squadron where 
min{Mj^,M 2 l ^ a. There are R repairmen assigned to the squadron 
where each repairman is capable of repairing both types of 
modules . 

Next, let X^(t), i = 1,2, denote the number of modules 
of Type i, i = 1,2, that are in or require repair at time t. 
Thus the number of operational aircraft is min{a,Mj^-Xj^ (t) , 

M 2 -X 2 (t) } where it is assumed that an aircraft requires both 
modules (one of each) to be considered operational, and this 
is the number of aircraft that are failure-prone; the others 
are awaiting one or both of the Type -1 and/or Type-2 modules. 
Finally, it is assumed that repair is Markovian (or exponen- 
tial); denotes the rate at which an individual repair 

of Type i, i = 1,2, is completed at Shop i. 
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The repair process factors include repair time (diag- 



nostic, removal of module from aircraft, ordering parts, 
repair of a failed module, testing of a module after repair, 
quality assurance inspection) , and the queueing discipline 
used in the shop. For example, first-come-f irst-serve , or a 
priority system may be employed. 

The major factors affecting the assignment decisions 
are the number of modules down requiring repair of each type, 
and the number of repairmen assigned to the maintenance organi- 
zation. Therefore, the maintenance commander has to choose 
one decision among a finite set of possible decisions while 
considering the combat effectiveness of the squadron. The 
combat effectiveness of the squadron during peace time (be- 
tween combat occasions) can be assumed to represent the readiness 
of the squadron at any point in time, which can be represented 
by the expected number of aircraft ready (or up) to engage in 
combat at the time the squadron must respond to an attack. 

This chapter presents a mathematical model that will 
identify an optimal repair policy among finite feasible poli- 
cies that are available for the commander to follow. As will 
be seen, the policy is idealized so as to allow calculations 
to be made. It does not recognize all reasonable constraints 
to which the repair system is subject. Nevertheless it, or 
its extensions, should provide some useful guidance for a 
decision maker. 
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The two major factors affecting the repair policy 



are the failure rate and the repair rate of each type. The 
failure rate of each type of module depends on the number of 
aircraft, the failure rate of a module, the conditional proba- 
bility of the module failing given an aircraft reported failed, 
and the total number of spare modules available. 

The repair rate of each type is a function of the 
repair rate of a single repairman or team, the number of 
repairmen assigned, and the number of modules of the same 
type down at a given time. 

These two major factors will be considered in analyzing 
the repair policy in this chapter. 

3 . Repairmen Assignment Decisions 

The repairmen assignment decisions are the responsi- 
bility of the maintenance commander (supervisor) . The decision 
concerning the number of repairmen to be assigned to each 
repair shop when the state of the system changes should follow 
a (nearly) optimal repairman assignment policy; such a policy 
is referred to in this study as the repair policy. The factors 
affecting the repair policy can be classified as; 

dependent upon the logistics system of the squadron, or 
dependent upon the repair process. 

The logistics system factors include the availability 
of maintenance tools, documentation, preventive maintenance 
program, spare parts when needed, quality assurance program, 
and many others. In what follows the influence of such factors 
will be left implicit. 
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E. 



PROBLEM CHARACTERISTICS 



The problem is characterized by these main aspects: 

Demand process. 

Repair process. 

Repairmen assignment decisions. 

1 . Demand Process 

The demand process depends on factors that include 
number of aircraft in operation, number of pilots assigned, 
probability of failure of modules, possibility of a simul- 
taneous failure, i.e., resulting in a simultaneous demand. 

2 . Repair Process 

The factors affecting the repair process can be 
categorized as: 

Factors related to the maintenance organization. 

Factors related to the operational organization. 

Other factors. 

Maintenance organizational factors include the number 
in various skill categories of repairmen, the location of 
different shops, rate of repair, availability of tools and 
test instruments, and the cannibalization policy. 

Operational factors include number of aircraft assigned 
to the squadron, type of missions the aircraft are conducting, 
pilot skills and training, failure rate of the modules in- 
stalled, and the sortie frequency. 

Other factors include weather conditions, foreign 
object damage (FOD) , manufacture or urgent maintenance bulletins, 
changes in type of threat, and number of spares available. 
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representing state i. The dimensionality of Y(i) depends 
on the type of actions considered. 

For example, if { ( t ) , X 2 ( t ) , (t ) , ( t ) ) , t ^ 0} repre- 

sents the number of modules of types 1, 2, 3 and 4 down, 
respectively, and the action to be determined is the total 
number of repairmen to be assigned to the maintenance facility, 
i.e., the repairmen are assumed to be capable of repairing 
all types of modules f then yd) is a scalar. More realis- 
tically, suppose that the supervisor is assigned R repairmen, 
and the action to be taken is to distribute the R repairmen 
among the four shops. Then y(i) is of dimension 3. The first 
component of y(i) will be R^^ , the number of repairmen to be 
assigned to Shop 1. The second component is R 2 , the number 
of repairmen assigned to Shop 2, and the third is R^ > the 
number of repairmen assigned to Shop 3. R^ , the number of 
repairmen assigned to Shop 4, is the balance, R^ = R- (Rj^+R 2 +R 2 ) 
and need not be a component in the vector y (i) . 

Therefore, if a stationary policy is employed then the 
sequence of states {X(t),t ^ 0} where X(t) is a vector, forms 
a multi-variate continuous-time Markov process with a transi- 
tion probability P. . (t) = P. .(t,y(i)). As in the univariate 
case there will be a unique infinitesimal generator for every 
policy to be considered. 
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{X(t),t ^ 0} forms a continuous-time Markov process with a 
transition probability. 



P. (t) = P .(t,Y(i)) . (3.1) 

f J ■*- / j 

The evolution of the system from state to state described 
by P- •(t,Y(i)) depends on the infinitesimal generator whose 

1 f J 

elements are q(j|i,Y(i))/ j = 1,2,. ..,M, where 0 ;^q(j|i,Y(i)) < 

j 7 ^ i , is the rate of transition from state i to state j when 

M 

decision Y(i) is employed, and q(i|i,Y(i)) = - J, q{j|i,Y(i))- 

i=l 

j^i 

Therefore a collection of the row vectors q(j|i,Y(i)) 
for i = 1,...,M will form an infinitesimal generator that 
uniquely determines a continuous-time Markov process. That is, 
the probability is q ( j | i , y ( i) ) dt + o (dt) that the system will 
be in state j at time t+dt , 0 £ dt <6, 5 > 0, given that it is 
in state i at time t and action y(i) ^ is always used in 
the interval [t,t+6) when the system is in state i. 

The preceding statement can be generalized for the multi- 
variate-continuous-time Markov process. A state can be repre- 
sented by a vector whose components are the states for the 
marginal-continuous-time Markov process. Let m be the 
cardinality of the set of all possible state vectors; then 
the system can be found in one of m possible states labeled 
l,2,...,m at any point of time. When the system is in state 
i an action Y(i) is chosen from a finite set F^. The dimen- 
sionality of Y(i) need not be the same as the vector 
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The vector whose components are (t) for all K types of 
modules installed on the aircraft, is taken to be the state 
of the system. Because the probabilistic nature of the 
system state changes, the process X(t) = 1 X^^ (t ),..., Xj, (t) ; 
t ^ 0} represents a multivariate stochastic process. It 
will be assumed that the state of the system at time (t+s) 
given the history to time t is a function only of the state 
at t, so the process can be handled as a multivariate- 
continuous-time Markov process. If the supervisor is able 
to make a decision on the required number of repairmen to be 
assigned to every shop, every time the state of the system 
changes, then the problem can be formulated as a raultivariate- 
continuous-time Markov decision process. Although it may be 
unrealistic to assume that the personnel are so rapidly inter- 
changeable, this is the situation that is examined. 

Consider a system, S, which at any point of time must 
be in exactly one of s possible states, labeled l,2,...,s. 
Suppose S operates from time zero to time T, where T -> «>. 

When S is in state i, an action y is chosen from a finite set 
of possible actions, and the return rate is f(i,y) that 
depends only on the current state and action taken. 

The policy is assumed to be a stationary policy. A policy 
is said to be stationary if it is non randomized and the 
decision it chooses at time t depends only on the state of 
the process at time t (Ross, 1983). It follows that if a 
stationary policy is employed then the sequence of states 
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C. SCOPE 

An air-interceptor squadron is selected to represent the 
operational situation under study. The squadron is considered 
to operate independently of other squadrons. An aircraft re- 
quires a certain number of its systems to operate in order to 
be considered operational. The shop supervisor is assigned 
R repairmen capable of repairing all types of systems installed 
on the aircraft (i.e., general technicians). 

This study concentrates on finding the optimal way of dis- 
tributing the repairmen among different shops. Here the term 
"optimal" refers to the maximization of the readiness of the 
squadron. Ultimately the readiness of the squadron is assessed 
by its ability to engage into air combat when called upon with 
the maximum number of interceptors in an attempt to minimize 
the number of enemy bombers reaching their targets. 

D. APPROACH 

To achieve the above objectives, the repair process of 
the squadron during peace-time or non-combat periods has to 
be analyzed. The effect of the repairmen assignment decisions 
constitutes the restrictions for determining the optimal repair 
policy. When an aircraft lands, the entire repair shop com- 
plex experiences simultaneous demands for several different 
types of repair. It is assumed that an aircraft consists of 
several types of systems; for example, engine (propulsion), 
communications, airframe systems, etc. The system is referred 
to as a module. Let the number of modules of type i down for 
repair at time t be {X^(t) ,t ^ 0}. 
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III. 



FORMULATION AND ANALYSIS OF A PROBLEM IN REPAIRMEN 
ALLOCATION FOR AN OPERATIONAL LOGISTICS SYSTEM 



A. INTRODUCTION 

This chapter models a repair shop maintenance process for 
a given aircraft squadron. The model formulation is based on 
a stochastic continuous-time Markovian decision process. 
Mathematical programming optimization techniques are imple- 
mented to determine the optimal repair policy. After this brief 
introduction, the objectives of this chapter will be presented, 
followed by the scope of work. The problem characteristics 
will be introduced, followed by the assumptions used in the 
model. The model is then developed, and sample solution of 
the model, using dynamic and linear programming techniques, 
are analyzed and verified. The optimization techniques are 
compared, and potential opportunities for improvements are 
suggested . 

B. OBJECTIVE 

The objective of this chapter is to formulate and analyze 
a repair policy for an aircraft squadron. Analysis of the 
repair policy means determining the various repair policies 
available to the shop supervisor, defining the effect of each 
policy on the squadron readiness, and selecting that repair 
policy which maximizes the expected number of aircraft ready 
to engage or "scramble" when an attack occurs. 



106 



From equation (2.35) the expected probabilities for 
the number of modules down at the time of attack become: 

State: (i,j): (0,0) (0,1) (0,2) (1,0) (1,1) (1,2) (2,0) (2,1) (2,2) 

E[P. .(W)] : .5825 .1269 .0170 .1433 .0491 .0074 .0570 .0147 .0017 

Hence, from equation (2.36), the readiness is given by: 

P{D(0) = 0} = .0978 

P{D(0) = 1} = .9022 

The example vias used only to show a simple applica- 
tion for the method of computing the operational readiness 
of the aircraft-squadron using the matrix geometric approach. 

The results obtained were compared with the results obtained 
by writing down the generator and solving for the limiting dis- 
tribution, and for the Laplace transforms. The results obtained 
were the same as those obtained using the matrix geometric ap- 
proach. The matrix geometric method has the attractiveness that 
at any time we are working with small-size matrices, which 
allows for solving a large-scale problem. As shown before, 
if we are considering a system with = M 2 = 100 modules, 
then the infinitesimal generator will be of size 10,201 xl0,201, 
which is too large to calculate the limiting distribution and 
Laplace transform by solving ttQ = 0, ire = 1 directly. Using 
the matrix geometric approach, we can only work with matrices 
of size 101 X 101, which are much smaller. 
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( n,mK 


(0,0) 


(0,1) 


(0,2) 


(1,0) 


(1,1) 


(1,2) 


(2,0) 


(2,1) 


(2,2) 


(0,0) 


.8370 


.0640 


.0032 


.0637 


.0219 


.0016 


.0058 


.0024 


.0003 


(0,1) 


.5270 


.3522 


.0165 


.0505 


.0297 


.0060 


.0051 


.0025 


.0004 


(0,2) 


.4296 


.2818 


.2132 


.0404 


.0238 


.0048 


.0040 


.0020 


.0003 


(1,0) 


.5312 


.0496 


.0026 


.3488 


.0284 


.0016 


.0289 


.0084 


.0004 


(1,1) 


.4179 


.1567 


.0099 


.1567 


.2126 


.0092 


.0198 


.0141 


.0030 


(1,2) 


.3616 


.1701 


.0666 


.1011 


.1283 


.1495 


.0125 


.0086 


.0018 


(2,0) 


.3541 


.0331 


.0018 


.2325 


.0189 


.0011 


.3526 


.0056 


.0003 


(2,1) 


.3088 


.0759 


.0047 


.1557 


.0926 


.0041 


.1490 


.2079 


.0013 


(2,2) 


.2798 


.0920 


.0217 


.1179 


.0896 


.0451 


.0887 


.1212 


.1441 



The following are the values for it 



P 

n,m n,m 




( n , mr \ 


(0,0) 


(0,1) 


(0,2) 


(1,0) 


(1,1) 


(1,2) 


(2,0) 


(2,1) 


(2,2) 


(0,0) 


.2793 


.0214 


.0011 


.0213 


.0073 


.0005 


.0019 


.0008 


.0001 


(0,1) 


.0867 


.0568 


.0027 


.0082 


.0048 


.0010 


.0008 


.0004 


.0001 


(0,2) 


.0194 


.0127 


.0096 


.0018 


.0011 


.0002 


.0002 


.0001 


0 


(1,0) 


.0915 


.0085 


.0004 


.0601 


.0049 


.0003 


.0050 


.0014 


.0001 


(1,1) 


.0412 


.0155 


.0010 


.0155 


.0210 


.0009 


.0020 


.0014 


.0003 


(1,2) 


.0094 


.0044 


.0017 


.0026 


.0033 


.0039 


.0003 


.0002 


0 


(2,0) 


.0398 


.0037 


.0002 


.0262 


.0021 


.0001 


.0397 


.0006 


0 


(2,1) 


.0 D 4 


.0033 


.0002 


.0068 


.0040 


.0002 


.0065 


.0090 


.0001 


^2,2) 


.0018 


.0006 


.0001 


.0008 


.0006 


.0003 


.0006 


.0008 


.0010 



104 



< i Oa 



2 



0 



0 



D, 




0 2 0 
0 0 2 



E 



2 




-3 

2 

0 



0 0 

-5 0 

4 -7 



E 



-1 

2 



-.333 


0 


0 


-.1333 


-.2 


0 


-.0762 


-.1143 


-.1429 



El = Bi + Ci[-E 2^]D2 - nl 



-3.34 .24 



0 



2.0686 -5.3971 .2286 

0 4-7 



E 



-1 

1 



-.3081 

-.121 

-.0692 



-.014 

-.1954 

-.1117 



-.005 

-.0064 

-.1465 






-1.3526 


.2447 


.0015 1 


2.0622 


-3.3995 


.2319 


0 


4 


-5 ! 



Using Proposition (2.4), we get the following values for 

. . (n) : 

n , m ; 1 , D 
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Hence, the matrices n = 0,1, , n = 1,2, and 

G 2 r n = 0,1,2 can be determined using the above rates. 



= - (F + p„F^°^A = 



-.5 .2 

2 -2.5 

0 4 



= - (F^^^+G^^^+G2^^ ) + G^^^A*^ + P2F^^^A = 



-2.5 

2 

0 



. 2 

-4.5 

4 



B, 



-(5{21 +a<2), + a(2);,T 



-2 0 0 
2-4 0 

0 4-6 



^0 = 



2 .1 0 

0 .2 .1 

0 0 0 






2 .1 0 

0 .2 .1 

0 0 0 




2 0 
0 2 
0 0 



0 

0 

2 
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Hence , 



P{D(0) = 0} = .234 



and 



P{D(0) =1} = .766 

Assume there is a warning that is exponentially 
distributed with mean = 1 day. The failure rate during this 
period drops from A = 1 aircraft per day to A' = 0.5 aircraft 
per day, and = 1, ^2 ~ 1 modules per day increase to y| = 2, 
y^ = 2 modules per day. To find the readiness at the time of 



the attack, we need 


to determine 


the parameters 


of the new 


stochastic process 


[X^ (t) ,X2 (t) ; 


t > 0}. The rate parameters 


are state dependent 


as follows : 






State 

(i, j ) 


f (i,j) 


( i / j ) 


g2 ( i ' j ) 


(0,0) 


.5 


0 


0 


(0,1) 


. 5 


0 


2 


(0,2) 


0 


0 


4 


(1,0) 


. 5 


2 


0 


(1,1) 


.5 


2 


2 


(1,2) 


0 


2 


4 


(2,0) 


0 


2 


0 


(2,1) 


0 


2 


2 


(2,2) 


0 


2 


4 
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To renormalize 



b = TT^e + = 1.5497 

Therefore, dividing by b we obtain: 

tTq = [.3985 .1927 .0541] 

= [.2057 .1178 .0312] 

^2 ^ [.1343 .0520 



To renormalize. 



n=0 



b = y TT e = 1.1941 

^ n 



Therefore, we obtain: 



TT, 



= [.3337 .1614 .0453] 



IT, = [.1723 .0987 .0261] 



T\^ = [.1125 .0435 .0066] 



Therefore the readiness is: 



P{D{0) = 0} = 



2 1 

I ^i 2 + ^ ^2 i 

i=0 j=0 



.0079] 
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-1 


0 


0 




-1 


0.0 


0.0*^ 


H2 = B2 = 


1 


-2 


0 


II 

1 — 1 

1 CN 


-0.5 


-0.5 


o 

• 

o 




0 


2 


-3 




-0.333 


-0.333 


-0.333 
















. 



-1.5 0.5 0.0 

1.2667 -2.7333 0.4667 

0 2-3 

Therefore : 



H. 



= + 






H 



-1 

1 



-.8074 


-.1667 


-.0259 


-.4222 


-.5 


-.0778 


-.2815 


-.333 


-.3852 



"o ‘ ®0 



+ C„(-H-ho^ 



-.5926 


. 5667 


.0259 


1.2252 


-1.7333 


.5081 


0 


2 


-2 



From Proposition (2.2), we get: 



7T 



0^0 




e 



1 



Therefore : 



tTq = [.6175 .2987 .0839] 

r'l = ^qCq(-h"1) = [.3188 .1826 .0483] 
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0.2 0 

0.4 0.2 

0 0 

0.2 0 

0.4 0.2 

0 0 



Hence, the infinitesimal generator, Q, becomes: 





( 0 , 0 ) 


( 0 , 1 ) 


( 0 , 2 ) 


( 1 , 0 ) 


( 1 , 1 ) 


( 1 , 2 ) 


( 2 , 0 ) 


( 2 , 1 ) 


( 2 , 2 ) 


( 0 , 0 ) 


-1 


0.4 


0 


0.4 


0.2 


0 


0 


0 


0 


( 0 , 1 ) 


1 


-2 


0.4 


0 


0.4 


0.2 


0 


0 


0 


( 0 , 2 ) 


0 


2 


-2 


0 


0 


0 


0 


0 


0 


( 1 , 0 ) 


1 


0 


0 


-2 


0.4 


0 


0.4 


0.2 


0 


( 1 , 1 ) 


0 


1 


0 


1 


-3 


0.4 


0 


0.4 


0.2 


( 1 , 2 ) 


0 


0 


1 


0 


2 


-3 


0 


0 


0 


( 2 , 0 ) 


0 


0 


0 


1 


0 


0 


-1 


0 


0 


( 2 , 1 ) 


0 


0 


0 


0 


1 


0 


1 


-2 


0 


( 2 , 2 ) 


0 


0 


0 


0 


0 


1 


0 


2 


-3 



To compute the limiting probabilities, we need the 
following : 



Cq = = 



0.4 

0 

0 






0.4 

0 

0 






°2 = 



( 2 ) 
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Let 



0 


1 


0 




0 


0 


0 


0 


0 


1 


II 


1 


0 


0 


0 


0 


0 




0 


1 


0 


1 
















Let Q be the infinitesimal generator for the process, 
Therefore, using Proposition (2.1), we get: 



Q = 



B, 






Di 

0 D2 B2 



where : 



.(0) .^(0)^ ^ ^(0),,T 



( 0 ). 



B„ = -(F '+G^ ') + G' 'A + p-F A = 



+ P2F^^^A = 



0.4 


0 




-2 


0.4 




2 


-2 




-2 


0.4 


0 


1 


-3 


0.4 


0 


2 


-3 



B2 = -(G{2)+cf^ +G^2)^T ^ 



-10 0 
1-2 0 
0 2-3 
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Let: 



P2(t) 


= {P2Q (t) ,P2^ (t) ,?22 (t) } 


Pj^ (t) 


= {Pj^Q (t) (t) ,Pj^2 (t) ^ 


Po(t) 


^^00 '^01 '^02 ^ 



Define the failure and repair matrices 
as follows: 





1 


0 


0 






1 


0 


0 


= 


0 


1 


0 


1 

, F 


= 


0 


1 


0 




0 


0 


0 






0 


0 


0 




1 


0 


0 






1 


0 


0 


II 

* — 1 
' 1 — 1 
o 


0 


1 


0 


g^2^ - 

' ^1 


0 


1 


0 




0 


0 


1 






0 


0 


1 


and 




















0 


0 


0 






0 


0 


0 


- 


0 


1 


0 


, g1 


[1) _ 
) 


0 


1 


0 


i 


0 


0 


2 






0 


0 


2 












0 0 


0 












g^2^ 

^2 


= 


0 1 


0 
















0 0 


2 







and 
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Figure 2.4. Transition Rates: A Simple Example 

to Illustrate the Matrix Geometric 
Approach 
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4 . A Simple Example to Illustrate the Proposed Technique 



Consider one aircraft in operation. Suppose the air- 
craft is operational if it has both engine and avionics 
systems (one of each) installed and in operating condition. 
Suppose further that there are a total of 2 engines and 2 
avionics systems in the organization. Both engines are 
assumed to be repaired by an engine technician that is not 
capable of repairing the avionics system, and can only 
work on one system at a time. Suppose that the organization 
has a single engine technician and 2 avionics technicians. 

Let A = 1 aircraft per day be the total failure rate of the 
aircraft, the pilot reports failure due to engine with proba- 
bility pj^ = 0.4, and due to avionics failure with probability 
P 2 = 0.4, and due to a failure of both systems with probability 
p ^2 = 0.2. Let = 1 engine per day be the repair rate of 
the engine, and = 1 avionics systems per day. 

A graph of the state space and the transition rates 
for each state of the process (t) ,X 2 ( t) ; t ^ 0} is shown 
in Figure (2.4) . 

Consider {X^^ (t ) , X 2 (t) ; t ^ 0} as a Markov process on 
the state space {S 2 ,S 2 ^,Sq} as defined below: 

S 2 = {(2,0) (2,1) (2,2)} 

= {( 1 , 0 ) ( 1 , 1 ) ( 1 , 2 )} 

Sq = {(0,0) (0,1) (0,2)} 
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(2.3 



E[P{X^(W) = i,X2 (W) = j |W}] 



n 



M 2 

1 Z P • • (n ) 

n=0 m=0 ’ ■> 



Hence, the readiness probability distribution is 
then given by; 



M^-k 



M2 



-k-1 



I ^^^i M ^ ^f^M -k 0 < k < a-1 

i=0 ^ j=0 



P{D(0) = k} = 



M^-a M2"a 



I I E[P (W)] 

i=o j=o 



k=a 



(2.36) 



becomes : 



otherwise 



In terms of the Laplace transforms the above 



P{D(0) = k} = 



M^-k M2 



io nlo 



(n) 



M2-k-l M 2 



0 < k < a-1 



(2.37) 



Mj^-a M2 -a M2 

n z y y y ^ p ^(n) 

iio jio n=0 nio 



k = a 



otherwise 
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0 



G 



(n) 

2 



92 (n,l) 

V. 

•N. ^ 

^2 (n,M2 ) 



The readiness probability distribution can be 
calculated by solving for P{X(W) = i,X(W) = jjw}. 

From the law of total probability 



M 2 



P{X(W) = i,X(W) = j|w} = I I P{X, (W) = i,X„(W) = j 

n=0 m=0 



X 



^(0) = n,X 2 ( 0 ) = mjw} 



^1 ^2 



I I P{X^(W) = i,X 2 (W) = jlXj_(0) = n,X2(0) = m,w} 
n= 0 m= 0 



X P{X^ (0) = n,X 2 (0) = m} 



Therefore ; 



^1 ^2 . 

P{X^(W) = i,X 2 (W) = j[w} = I I P{X (W) = i,X 2 (W) = j 

n=0 m=0 

|Xj_(0) = n,X2 (0) = 

(2.33) 

Since ^ is non-random, taking the expectations of 
both sides of (2.33) with respect to W, gives the following: 
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and 



P . . (W) = P . . (W) . 

1 ] nm , 1 ] 



Let 



Pn(s) = = 



Using Proposition (2.4) , we find that the vectors 
for the Laplace transforms for the new, restricted, bivariate 

~ ~ /N 

birth-and-death process, (t) ,X 2 (t) ; t ^ 0}, P^(s), n = 0,1, 
can be determined, where: 



f (n,0) 



(n) 



f (n,l) 



f (n,M2-l) 






(n,0) 



(n) 



g^_ (n,l) 



g^ (n,M2) 



iU 
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To find the readiness probability distribution at 
the time of attack, it is required to find the number of 
modules of both types down at the time of attack. 

Let P . . (W) be the conditional probability of 
the process being in state (i,j) at W (i.e., when the attack 
occurs) given the process was in state (n,m) initially, and 
that W is exponentially distributed with mean n Therefore, 

Pnm,ij(W) = P{X3^(W) = i,X2(W) = jlx^(O) = n,X2(0) = m,W} 

Now, note that 



E[P 



nm, 1 j 



(W) ] = / 



nm , 13 



(t) n 



e dt 



It follows that: 



E [P . . (W) ] 
nm, 13 



nP • • (n) 
nm,ij ' 



So, as in the case of the single-module model, the required 
readiness is given terms of the Laplace transforms. 

In much of what follows, for simplicity of nota- 
tion, we will suppress the initial condition and write. 



P. . 
ID 



(t) 



P . . (t) 
nm, 13 



f 




P . • (s] 
nm , 13 



/ 
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f (i / j ) 



= A' min {a ,M^-i ,M 2 ~ j } 



9l(i.j) = j 

( y^Rj_ i = 



(2.31) 



92 (if j) 



j y2^ 3 1/2/.. •/ R^ 1 

^ y 2 ^2 ^ ^2 f * * * f^2 



The initial distribution for (t) ,X 2 ( t) ; t ^ 0} 
is the limiting distribution for {Xj^ (t) ,X 2 (t) ; t ^ 0} with 
parameters A, and y 2 / given by Proposition (2.2)j 

P{X, (0) = i,X,(0) = j} = TT. . (i,j) e S (2.32) 

Therefore, {Xj^ ( t) ,X 2 (t) ; t ^ 0} is a bivariate 
birth-and-death process, with initial conditions ^ for 
( i , j ) e S . Let 



Pnm,ij(t) = P{Xj^(t) = i,X 2 (t) = j|Xj_(0) = n,X 2 ( 0 ) = m} 
/\ 

and P . . (s) denote the Laplace transform for P . . (t) . 
nm , 1 ] ^ nm , 1 3 

Then , 



. . (s) = / e P . . (t) dt 



nm, 1 ] 



nm, 1 ] 
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M^-k 






I ^i.M -k ^ -k i 

i=0 -^'“2 j = 0 1 



0 < k < a-1 



P{D(0) = k} = 



Mj^-a M2~a 



I J IT . . 
i=0 j=0 



k = a 



(2.30) 



otherwise 



This assumes that attacks occur infrequently, so 
a steady-state distribution prevails, and that there is essen- 
tially no warning. 

b. Partial Surprise 

As in the Single-Module model formulation, 
suppose that the intelligence data suggests that the enemy 
will strike after W units of time (e.g., days) . Let W be a 
random variable exponentially distributed with mean n 
Assume that during the time W the failure rate decreases from 
A to A ' where A > A', and repair rates increase from and 
^2 to and y^, respectively, where y^^ < y| and y^ < y^- 

Let (t) ,X 2 (t) ; t ^ 0} be the number of modules 
of Type 1 and Type 2 down at time t. The process {X^^ (t) , 

X 2 (t) ; t ^ 0} is a bivariate-continuous-time-Markov process 
with rate parameters : 
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^ H 



T (s) = P. T (s)C. ^ [-E.^ , ] 

i-m-1 i-m-2 i-m-2 i-m-1 



_1 i^+l _i 

+ e/l-E. ] 



We have proved the following proposition. 



Proposition (2.4) 

The vectors Pj^(s)/ = 0,1,,.., M^, given that the 

process started in state (i,j), are given by: 







(s) 



e.[-E-h 



1 

n 

£=1 






P..k(3) 









0 _< k £ i-1; i £ £ Mg 



Pn(s) 






The readiness distribution can now be computed, 
a. Total Surprise. 

Under the Two-Module Logistics formulation, with 
a total surprise scenario, a readiness distribution model can 
be derived as follows: 
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From (2.29) we obtain: 



sP^_^{s) = P,_o (s)C,_., + P,_T (s)B,_t + P, t (s)C, ^]D, 



i-2 i-2 i-1 i-1 i-1 i-1 i i 

[-e“^]d. 

3 11 



Pi_l(s) 






Therefore the statement is true for k = 1. Suppose it is true 
for k = m, 0 < m < i. We need to show that it is true for 
k = m+1 . From the induction hypothesis we have, 






For k = m+1, using equation (2.18), 



sP. T (s) 
i-m-1 



P. o(s)C. T+P. ,(s)B. ,+P.(s)D. 

i-m-2 i-m-2 i-m-1 i-m-1 i-m i-m 



P. «(s)C. «+P. ,(s)B. , 

i-m-2 i-m-2 i-m-1 i-m-1 

t. 

+ P. T (s)e. T [-E. ]D. 

i-m-1 i-m-1 i-m i-m 



-1 -1 
+ e . [-E,-^] n D. [-E. J D, 



3 1 



£=1 



i-Jl+1 i-£ i-m 



Therefore ; 
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For the vectors from n = M, down to n = i+1 of P (s) , 

1 n ' 

we can use the results from Proposition (2.3). 



^n^®^ " ^n-1 ^ ^ i+l,...,M2 



Now, applying the argument in Gaver, Jacobs, and 
Latouche (1984) to equations (2.23), we obtain: 



sP^(s) - Oj 






Therefore : 



Pf(s) = (s)C^_^ [-E^l] +e.[-E^l] 



(2.29) 



Mathematical induction can be used to show: 



i-k 



<S> ^i-k-1 ' ^i-k' 



for 0 < k < i 



To show that the statement is true for k = 1, note 
that from equations (2.23), we obtain: 



sPi_i (s) 



Pi. 2 ‘ = >Ci .2 + P^.psjB..^ + P.(s)D^ 
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Multiplying the first line in the above equations by 
-1, and adding the normalizing equation, we obtain the equa- 



tions for the vectors n = 0,1,..., given by Proposition 

( 2 . 2 ) . 

Proposition (2.3) can only be applied if the process 
started with probability 1 in state (0,0). However, the 
analyst may need to calculate the Laplace transforms for 
the process with different initial conditions. In particu- 
lar, suppose one has positive probabilities P{X^(0) = i, 

X 2 ( 0 ) = j} for all states. 



other starting conditions, in particular to allow considera- 
tion of the partial surprise scenario. 



We need to generalize the above results to allow for 



Given the process started in state (i,j). 




e 



j 



1 



0,1 



r • • • r 



M 



2 



and 




0 



for all other k. 



where : 



e 



j 



(0 0 ... 010 ... 0 ) 



j = 0 , 1 , . . . ,M2 . 



The i 



. th 



element of e^ is equal to 1 whenever the 



process starts in state (i,j). 
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(1 0 



0 ) 



and , C^, and are as given by Proposition (2.1). 

Proposition (2.3) can also be used to find the limit- 
ing distribution as follows: 

TT = lim P (t) = lim sP (s) 

n ^ n „ n 

t-^-oo S“^0 

-> 

/\ 

Now, multiplying the equations for Pj^(s) given by 
Proposition (2.3) by s and letting s 0 , we obtain; 

lim sPp(s) [“Enl = lim , 

s->0 s->0 

and 

-> 

/N. 

lim sP„ (s) 
s->0 



/V -1 

= lim sP , (s)C„ n [-E ] 

„ n-1 n-l n 

s->0 



But : 



lim [E„l = H„ 

s->0 



Therefore we get: 



= 5 
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In the case n = 0, we obtain from the induction 
hypothesis , 



-1- 



P^(s) = Pq (s)Cq 



Substituting into the first line of (2.27), we get: 



sPo(s) - eQ 



Pq(s)Bq + Pq(s)Cq[-E^1]Dj^ 



Pq ( s) [-(B q+Cq [-E^^]D^- sI] = eQ 



Po{s)[-Eq] = Oq 



We summarize these results as Proposition 2.3. 

Proposition (2.3) 

-> 

/V 

The vectors n = 0,1,..., M^, are determined by 

the equations: 



Pq ( s) [ Eq] Oq 



Pn(s) 



- P ,(s)C ,I-e1) 

n-1 n-1 n 



where : 






= B 






E = B + C [-E ] D , T - si 

n n n^ n+1 n+1 
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si 



E 



n 




0 ^ n ^ M^-1 



E, 



M 



B, 



M 



si 



1 



1 



We have shown (equation 2.28) that the statement is 
true for n = . We will again prove the claim by induction. 

Suppose that the statement is true for n = i. We will show 
that it must also be true for n = i-1. 

For n = i-1, we get, from equation (2.22) that 





But from the induction hypothesis 




Therefore : 





P^_^(s) [- (Bj^_;L+^i-l [-Ej^^]D^-sI) ] 




Hence : 



P 



i-1 



(s) 
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(2.27) 



sPq(s) - Gq = Pq(s)Bq + Pj^(s)Dj^ 



sP (s) 
n 






-1 -1 (S)B, 






where e^ represents the initial condition 



Pq(0) 



= (1 0 ... 0) = e. 



Thus, we obtain; 















(2.28) 



where : 



E.. = B.. - si 



We claim that 






where : 
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[1 1 ... 1 ] 



and , C^, and are as given by Proposition (2.1). 

2 . Algorithm for Computing the Limiting Distribution 
The following algorithm was used to solve the recur- 
sive equations given by Proposition (2.2). The algorithm is 
based on the one given in Gaver, Jacobs and Latouche (1984). 

1. Starting v/ith , compute recursively the 

matrices H , for 0 < n < M,-l. 

n — — 1 

Solve the system = 0, TT^e = 1. 

— >■ 

Compute recursively the vectors n = 1 , 2 , . . . , ; 

and renormalize the vectors tt ' s so obtained at each 
stage (i.e., renormalize each time a new subvector 
is determined) . 

3 . The Laplace Transforms 

Following the argument in Gani and Purdue (1984) we 

/s 

can obtain an expression for P^(s), the Laplace transform of 

?n(t). 



2 

3 



P (s) = / e ®^P (t)dt 

n Q II 



— s t 

Multiplying both sides of (2.23) by e and integrating 
over all values of t, we get the following: 
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In the case of n = 0, we have: 



TT 



o®o 



+ 



0 






0 



Therefore : 



Thus, we have proved the proposition. 

Proposition (2.2) 

The limiting distribution for the bivariate-Birth-and 
Death process, for the Two Module Logistics model with simul- 
taneous failure is given by the following recursive equations 



TT 



0^0 



0 



-> 





n-1 



(-H 




1 £ n _< 



Ml 

I 

n=0 



TT e 
n 



1 



where : 






H = B + C (-H )D , 
n n n n+1 n+1 



0 £ n £ M^-1 
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The claim is that: 



. -1 

TT = TT .C T -H ) 
n n-1 n-1 n 



where : 



H 



n 



B + C (-H ^, ) D , 
n n' n+1 n+1 



Mt M, 



We will prove this by mathematical induction. We know from 
equation (2.26) that the statement is true for n = . 

Suppose it is true for n = i. We need to show that the state- 
ment is true for n = i-1 . From the second line of (2.20), 
we get: 



IT. ->C . _ + TT . .B. , + tt.D. 

1-2 1-2 1-1 1-1 1 1 



0 



Therefore : 



IT. ->C . „ + IT . ,B. , + n . ,C. ,(-H.^)D. 

1-2 1-2 1-1 1-1 1-1 1-1 1 1 






IT . T [B . , 

1-1 1-1 






-IT . 

1-2 



i-2 






TT 



i-1 




i-2 




] 



which proves the statement is true for n = i-1 . 
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In the case of n = 0, we have: 



”o®o + "ih ' “ 






Therefore : 



Thus, we have proved the proposition. 

Proposition (2.2) 

The limiting distribution for the bivariate-Birth-and 
Death process, for the Two Module Logistics model with simul- 
taneous failure is given by the following recursive equations 



" 0«0 



0 







n-l*^n-l 



(-H 




1 £ n £ 



Ml 

I 

n=0 



IT e 
n 



1 



where : 



M^ Mj^ 






0 n ^ Mj^-1 
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The claim is that: 



^ ^ iC T 

n n-i n-1 n 



where : 



H 



n 



+ C (-H h )D 
n n n+1 n+1 



M, M, 



We will prove this by mathematical induction. We know from 
equation (2.26) that the statement is true for n = . 

Suppose it is true for n = i . We need to show that the state- 
ment is true for n = i-1 . From the second line of (2.20), 
we get: 



-C. t + 1T. ,B. , +TT.D. 

1-2 1-2 1-1 1-1 1 1 



0 



Therefore : 



TT . tC . _ 

1-2 1-2 



+ ir . , B . , 

1-1 1-1 



+ TT. ,C. , (-H.^)D. 

1-1 1-1 1 1 






"i-hVi + <^1-1 <-»!"> 




i-2 






TT 



i-1 



->• 




C 



i-2 




] 



which proves the statement is true for n = i-1. 
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From the third line in (2.20), we get: 






-TT 






Thus 



M, 



-7T., T , (B„ ) 

Ml"! Mj^-1 



^ = TT„ T (-H,/ ) 

Ml"! Mj^-1 



From the second line in (2.25) , when n = M^^-l , we get 



7T., oC., T + 7T., T B,, T + 7T,, D.. — 0 

Mi~2 M^-2 M^-1 M^-1 



Substituting (2.26), we obtain: 



-> ->■ ,”1. 

'n’m 'fT.« T B.. 1 + TT.. tC f (~H., ) D. . = 0 

Mj ^-2 Mj ^-2 Mj ^-1 Mj ^-1 M ^-1 M ^-1 



Therefore : 



1 1 + C„ t (-H^^)D^ ] 

M^-1 Mj^-1 M^-1 



"7T 



M^-2 Mj^-2 



M^-1 



TT. . 0^n>i O T ^ 

Mi-2 Mj^-2 Mj^-1 



where : 



H., 1 = B,, T + C„ T (-H,/)D„ 

Mj^-1 Mj^-1 M^-1 



(2.26) 
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D = 1 < n < M, 

n 1 ^ ^ ± 

Therefore, by knowing and (n = 0 , 1 , . . . ) , 

we can use the above proposition to construct the infinitesi- 
mal generator, and hence the Chapman-Kolmogorov equations. 

Now, we are ready to find the limiting distribution for the 
process by adapting the argument from Gaver , Jacobs and 
Latouche (1984). 

1 . The Limiting Distribution 

The Markov-process (t) , X 2 (t ) ; t ^ 0} has been 
shown to have a limiting distribution. Let 

u = lim P (t) 
n . n 

t->-oo 

as t ^ 0 °, we get: 



t ^00 



Therefore, from (2.23), it follows that: 



^ 1°1 ^ ° 



TT tC ,+TtB + TT,,D,, 
n-1 n-1 n n n+1 n+1 



0 1 1 n £ M^-1 



(2.25) 



1 C., 1 + TT.. B.. = 0 

Mj^-1 Mj^-1 
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with initial condition: 



Pq(0) = [1 0 ... 0] , ° 1 1 ^ 1 



Thus, by comparing the system of equations (2.24) to (2.23), 
we have the following result. 

Proposition (2.1) 

The Bivariate-Birth-and-Death process (t) ,X 2 ( t) ; t ^ 0} 
for the Two-Module-Logistics model with simultaneous failure 
has infinitesimal generator 




where : 






( 0 ) 



B- = I-(f' '+G: ') + G' 'A + p.F' 'A] 



= [-(F^^^+g|‘^^+G2^^ ) + G.S^^a'^ + p^F^^^A] 1 1 n £ M^-1 



n 






B 



M, 



(M ) (M. ) (^1 ) T 

[-(G^ +^2 ) + G 2 A ] 



n 






0 £ n £ Mj^-1 



7 4 



P2f (0,M2-1) 
-g^ ( 0 , M 2 ) 












-f(0,0) P2f(0,0) 

g2(0,l) -(f(0,l)-hg2(0'l)) P2f(0/D 

X V ^ 

V, X. 

g2(0,M2-l) -(f (0,M2-l)-Hg2(0,M2-l))' 

92 ( 0 , M 2 ) 

9^(1, 0) 

9i(l/l) 

V 

V 

g^ (I/M 2 ) 






Therefore we get the following set of equations: 



dt 



Po ( t ) 



P. (t) [- + P-i (t)G 



dt 



Pn ( t ) 



dt 




( n - 1 ).^ p ( n - l ) 
12 ^ 



Pn_i (t) [piF'“ "-'+Pt^F'“ ^^A] 



+ Pj^(t) [- (F +g|“^^ +G2^Wg2^^ a'^+P2F A] 



+ P (t)G^”'^^^ 



PM ^- l ( t)[PiF 



(M -1) (M,-l) 

+P 12 F A] 



^ (M ) (M ) (M ) 

+ (t) [-{G^ ^ +G 2 )+G2 A ] 



( 1 ) 



( 2.2 
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^ p (t) = [p .(t) . . . p (t) ] 
dt n n,0 n,M_ 



-(f (n,0)+g^(n,0) ) P 2 f(n, 0 ) 



g2(n,l) -(f (n,l)+gj^(n,l)+g2(’^'l) ) P2f(n,l) 

\ 






g2(n,M2-l) - (f (n,M2-l)+gj^ (n,M2-l)+g2 ^ P2f(n,M2-l) 

g2(n,M2) - (g^^ (n,M2)+g2 ^ 









gj^(n,0) 

91 (n,l) 

-L \ 



\ 



\ 



\ 



g^(n,M2) 






Pj^f(n-1,0) pj^2^ 

Pj^f(n-l,l) pj^2^ (ri-1,1) 



Pj^f (n-l,M2-l) p^2^ 

0 



for n = 1 , . . . ,Mj^-l 
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From equations (2.21), we can obtain the equations for 
d 

^ P^(t), (n = and expressing these in matrix form 

gives : 



dt 





,0 




(t) ] 



g2(M^,l) - (g^ (M^,l)+g2 ) 

V. '' 

V, 

V. 

0 

92<''-1'«2> 









0 



-(g2^(M^,M2)+g2 ^ 



X 



Pff (Mi-1,0) 






Pj^f (M^-1,M2-1) p^2^ 

0 



71 



The forward Chapman- Kolmogorov equations are given by: 



^P(t) = P(t)Q 



1 . e . , 



Pl(t) . 






[PQ(t) Pj^(t) . 



.. Pj,^ (t)] 

^ 1 



S 

Dp 






D 






B 



M, 



Hence, the forward Chapman-Kolmogorov equations become: 



it 






it 



* Pnn.l<t)Dntl 



1 £ n £ Mj^-1 



it ' 






. 23 ) 
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(n,0) 



(n) 



g^ (n,l) 

V. 






(n,M2) 



(n) 



g2(n,i: 



g2 (n ,M2 ) 



Let Q be the infinitesimal generator for the Markov 
process (t) ,X 2 (t) ; t ^ 0}. Then Q will be a block tri- 
diagonal matrix as follows: 




where B , C , and D are square matrices of order M_+l. The 
n n n z 

diagonal elements of the diagonal matrices are strictly 

negative and are determined so that the row sums of Q are zero. 

The process can be fully defined by the infinitesimal generator 

and the initial condition. Therefore, we need to determine 

all of the elements of B , C and D . 

n n n 
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Let 



1 






^ M ^-1 



^^M^-1,0 '^M^-1,1 (■^^ ' * * * '^M^-1,M 



?! (t) ^^1,0 '^1,1 ^^^ ' ‘ * * '^1,M2 ^ 



P^(t) = {P^ n(t),P^ ^(t),...,P. „ (t)} 



0 , 0 ' ' '" 0,1 



0 ,M, 



Define the following matrices: 



(n) 



f (n,0) 



1 



f (n,l) 



f (n ,M2“1 ) 



0 1 



0 1 



A = 



1 

0 



(t) } 

2 



68 



system of equations tends to be large as and M 2 increase- 
For example, if there are 50 modules of both types, the system 
has 2,601 equations. Thus, for a large maintenance system, 
the above approach would be infeasible to follow. Therefore, 
another approach is desirable. The Matrix Geometric Method 
of M. Neuts (1981) is the alternative pursued here. 

H. MATRIX GEOMETRIC APPROACH 

Following the approaches in Neuts (1981) , and Gani and 
Purdue (1984), we now formulate the continuous time Markov 
process model for the two-module logistics problem. This 
formulation facilitates computations for modules of realistic 
number . 

Consider {X^ (t) ,X 2 (t) ; t ^ 0} as a Markov process on the 
state space ,Sj^ _ , . . . , S , Sq } defined below. 

= { (Mj_,0) , (Mj_,l) , . . . , (Mj_,M2) } 

= { (Mj_-1,0) , (Mj^-1,1) , . . . , (Mj_-1,M2) } 

= { (1,0) , (1,1) , . . . , (1,M2) } 

= { (0,0) , (0,1) , . . . , (0,M2) } 
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0 



-f(0,0)TTQQ + gj^(l,0)7T^Q + g2(0,l)TTQj^ = 



-(f(i,0) + g^^ (i,0) ) ( i-1 , 0) tt^_^ q 

+ + g2 (i,l) = 0 

-(f(0,j) + g2(0,j))TTQj + P2f (0, j-l)TTQ^ 

+ gj_(l,j)TT^j + ^2 j + 1 " ° 



(f(i,j) + gj^(i,j) + g2 (if j ) )'fT^j + Pi^ ^ ) ^i-1 , j 



(2.22) 



<9l(i'«2) + 92'i'«2>>"i,M2 ■" Pl2* ”i-l ,[<2-1 

+ P2f(i,M2-l)n.^„ 1 + gi(i + l,M2)7,.^2,M, ' ° 



(gj(M2,j) + g2<Mi.3)"M^, j + Pl*<^'i-l'2>"H2-l,j 

+ Pj2f(Mj-l,j-l)n„^_l^ ._1 + g2(M2,j+l)u„^_ .^1 = 0 



(gi(Ml+M2) + gg ^^M2/M2 '*' , M 2 -I 



= 0 



M M 
1 2 



I I tt.. = 1 

i=0 j=0 



Therefore, it is require(3 to solve (M^^+l) (M 2 + I) linear systems 
of equations to compute tt.. V (i,j) e S. The size of the 
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dt 



dt 



+ Pj^f(M^-l,j)P^^_^^ . (t) 

+ Pi2f<Mrl'3-l)PM^-l,j-l<t) 

+ 92 j+1 1 1 j 1 ^2"^ 

-(9l'Hr»2) + 92 (Mi.H2>>Pk^,M2"^' 

+ Pi2^ ^Mj^-1,M2-1 



with initial conditions: 



P. . (0) 
1/ J 



/ 1 



I 



if i = j = 0 



0 otherwise 



The bivariate continuous-time-Mark6v process 
{Xj^ (t) ,X 2 (t) ; t 0} has already been shown to have a limiting 
distribution. Define ^ to be the limiting probability of 
the process being in state (i,j), i.e.. 



Tr . 
ir J 



lim P . ■ (t ) 



Taking the limit, as t ->■ <», in the forward Chapman- 
Kolmogorov equations, gives the following system of equations: 



65 



Subtracting P. . (t) from both sides and dividing by dt, and 

^ f J 

letting dt tend to zero, gives the following: 






dP. „(t) 

^ = -(f(i,0) + g^ (i, 0) ) Q (t) + Pj^f (i-l , 0) P^_J^ ^ Q (t) 

+ g^(i+l,0)P._^3^^Q(t) + g2(i,l)P. ^^(t) 

1 £ i ^ M.^-1 



dPo .(t) 

= -(f(0,j) + g2 (0, j) )Pq^ j (t) + P2f (0, j-1) Pg^ (t) 

+ g^{l, j)Pj^^ j (t) + g 2 (0, j + l)Pg^ (t) 

1 £ j £ M2“1 

dP . . (t) 

— = -(f(i,j) + gj^(i,j) + g2(i,j))P^^j (t) 

+ pj^f (i-1, j)P^_j_^ j (t) + p^2^ j_i 

+ P2f (i, j-l)P^^ (t) + g^(i+l,j)P^_i_^^ j (t) 

1 £ i £ M^-1, 1 f. j 1. M2~1 (2.21) 



3t “ -(gj^(l,H2) + ?2 *'■'*^2* *^i,M2 

+ Pl2£(i-l.M2-l'Pi-l,M2-l'*) 

H. P2f(l,«2-l)Pi^„^.l(t) 
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3. Formulation III 



Under this formulation, it is assumed that the condi- 
tional probability of a simultaneous failure of both Types 
(P 12 ) is positive. { (t ) , X 2 ( t ) , t ^ 0} is a bivariate 
birth-and-death process with parameters given by (2.17). 

Define P . . (t) to be the conditional probability of 
the process being in state (i,j) given that it started in 
(n,m) . Then, 

(t) = P{X. (t) .= i,X. (t) = j 1 X^ (0) = n,X^ (0) = m} . 

nm , 1 j 1 2 ' 1 2 

To simplify the notation we suppress the initial condition 
and write. 



P. . 



(t) 



P 

nm, 1 j 



(t) . 



To obtain the forward Chapman-Kolmogorov equations, we 
write the probability that the process is in state (i,j) at 
time t+dt as a function of the state probabilities at time t. 

The probability of being in state (i,j) at time t+dt is expressei 
by : 



P. .(t+dt) = (l-(f(i,j) + g,(i,j) + g_(i,j)dt)P. . (t) 

1,J _L Z -L/J 

+ Pj^ (f (i-1 , j ) dtP^_j^ j (t) + pj^2^ 

X + P 2 f ( 1 , j-l)dtP^^ (t) 

+ g^^ (i+1, j)dtP^^^^ j (t) + g2 (i, j + l)dtP^^ (t) 

+ o(dt) 
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Figure 2.3 



Transition Flov/ for the Two-Modules 
Logistics Process Under Formulation II 






{ ( t ) , X 2 ( t ) , t ^ 0} is a bivariate birth-and-death process, 
operating on the state space S = {( 0 , 0 , M 2 )} . Figure 
(2.3) shows a graphical representation of the rates of transi- 
tion between states. 

It is clear from the figure (2.3) that state (M^,M 2 ) 
is a transient state. Hence: 



lim 

t-^oo 



^M^M2 ^ ^ ^ 



0 



It is also clear that once the state vector departs 
from value (M^,M 2 ), the process will never reach (M^^,M 2 ) 
again. So unless the process starts in state (M^^,M 2 ) , this 
state will never be visited. Since the initial condition is 
assumed to have all modules up, the supervisor can never ex- 
pect to have all modules of both types down at any point in 
time. This results from the fact that under this formulation 
it is assumed that when an aircraft is down awaiting modules, 
it is waiting for one module only, never both types. This 
assumption is very optimistic and it doesn't represent a 
flight-line logistics operation. Therefore, it was concluded 
that this formulation is inappropriate for the aircraft- 
squadron logistics problem. 

The preceeding two formulations suggest that a simul- 
taneous failure mechanism (i.e., p ^^2 > is necessary in 
order to provide operational realism. This is carried out 
in the next section. 



61 



where : 



B = 



N 

^ \ M -1 

k=l I k 



M, -1 

k 



I 



M, -1 

k 



n f (j) 

j = 0 



i=l i 

n g 3 ^(j) n 

j=l j=i 



-1 



n 9k (j) 

j=i ^ 



2 . Formulation II 

Under this formulation, it is assumed that p ^2 ~ 0, 
i.e., there is no simultaneous failure of both items. Air- 
craft can be reported down either because of a failure of 
Type 1 , or a Type 2 module, with probabilities p^ and P 2 / 
respectively; where p^^ ~ Therefore the rate parameters 

are given by: 



Pj^f (i, j) , k = 1,2 



where 



f(i,j) = A min {a ,Mj^-i ,1^2“ j } 

while gj^(i,j) and g 2 (i/j) the same as given by equations 

(2.17) . 

Define (t) ,X 2 (t) ; t ^ 0} to be the number of modules of 
Type 1 and Type 2 down at time t, respectively. 
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where : 



B 



2 

n 

k=l 



1 

M]^-l 

n f,(j) 

j = 0 



+ I — 

i=l i 



M, -1 

k 



n gj^(j) n fj^(j) 

j=l j i 



+ 



«k ( 



The assumption made under formulation I results 
in a very simple and unrealistic system, because an aircraft 
requires only one type of module to be considered as a mission 
capable aircraft. This formulation is impractical for 
aircraft squadron scenarios where the objective of the 
maintenance commander is to maintain the highest possi- 
ble readiness in the squadron. The above formulation could 
be used for modelling a depot repair system where there are 
multiple types of modules that could be assumed to demand 
repair independently. A generalization of the above method 
that can accommodate the depot repair scenario is trivial and 
a closed product form solution for the limiting distribution 
of the joint probability can be found. Suppose there are N 
different types of modules. Then: 



ng , . . . , n^ 



N 

n 

k=i ^k 



B 



M, -1 
k 



n gj^(j) n 

j=l 
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7T 



B 



iO 



^ij 



OM, 



ir 



M^O 



iM, 



M^j 






i 




Ml"! 


M 2 -I 




n 

n=l 


(n) 


n fi(n) 

n=i 


n f, (n) 
n=0 








B 






i 




Ml”! 


j 


M2-1 


n 

n=l 


(n) 


n fi(n) 

n=i 


n 92 (n) 

n=l 


n 

n=j 






1 < i £ Mi~ 


1; 1 1 j 


< M2- 






B 






1 — 1 

1 

r — 1 




M2 






n 

n=0 


fl(n) n g2(n) 

n=l 










B 






1— 1 




M 2 -I 






n 

n=l 


g^ (n) 


n f„(n) 
n=0 










B 




1 < 


i 




Ml"! 


M2 




n 

n=l 


gi (n) 


n fi(n) 

n=i 


n 92(0) 

n=l 








B 




1 < 


Ml 




j 


M2-1 




n 

n=l 


g^ (n) 


n (n) 

n=l 


n £3(^1) 

n=j 








B 






Ml 




M2 






n 


g^ (n) 


n g9(n) 






n=l 




n=l 







V X 



-1 



( 2 . 20 ) 
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0 



-fk(0)7T^ + 



- j ) +g^ ( j ) ) TTj + 



0 



1 < j < M^-l 



(2.19) 




0 



where the last expression is the normalizing equation. 

The marginal processes {X^Ct), t ^ 0}, k = 1,2, 
can be viewed as independent closed migration processes. 
Hence, the joint distribution is equal to the product of the 
marginals, which are given by (2.19). 



Let TT^j be the limiting distribution for the 
joint process { ( t ) , X 2 ( t ) ; t ^ 0} . Then: 




1 2 
TT . 7T . 



Therefore, we get: 



B 




M 2 -I 

n f,(n) 
n=0 



n f, (n) 
n=0 



B 



1 < j < M 2 -I 



TT 



Oj 



Mj^-1 

n 

n=0 



M 2 -I 

n f2(n) 
n=j 



3 

fj^(n) n g2(n) 
n=l 
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The forward Chapman-Kolmogorov equations using the 
same probabilistic argument as in the Single-Module Logistics 
formulation, are given by: 

+ fk(j-l)Pj_i(t) 

fj^(0)PQ(t) + gj^(l)P^(t) (2.18) 

with initial condition: 

j 1 if j = i 

. (0) = k = 1,2 

1 ^ J I 

' 0 otherwise 

a. Limiting Distribution for Formulation I 

k tin 

Let Tij denote the long run probability of the k 

process, k = 1,2, being in state j. Then: 

7T^ = lim p’^ . (t) k = 1,2 

3 t-oo i'3 

dp’^(t) 

If the limits exist, then lim — i-r = 0, therefore, 

^ dt 

t-^oo 

the forward Chapman-Kolmogorov equations become: 



dPj (t) 
dt 



dPQ (t) 

dt 

dpj^ (tl 



dt 
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1. Formulation I 



Under this formulation, it is assumed that the two 
modules fail independently. The assumption states that an 
aircraft requires only one of the two types to be considered 
a mission capable aircraft. That is, as long as there is one 
module, regardless of its type, installed on the aircraft 
then the aircraft can perform its mission. Suppose that the 
rate parameters are given by; 



= p, Xmin{a,M, -j } 



k = 1,2 



' j 



I D 1/2,..., 1 



k k j = R, , . . . ,M, 
k > 



k = 1,2 



where p^^+ P 2 = 1 . 

Under the above assumption, the marginal processes 
{Xj^(t), t ^ 0} and {X 2 (t), t ^ 0} are two independent birth 
and death processes. 



th 



Define (t) to be the conditional probability of 



the k process, k = 1,2, being in state j given that it 
started in state i. Then 



P^j(t) = P{Xj^(t) = j|Xj^(0) = i} k = 1,2 

Let 

Pj(t) = P^j(t) 
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t 




t+dt 


Probability 


(i/ j ) 




(i+ 1 / j ) 


p^X min {a ,Mj^-i ,M2~ j }dt 






(i/ j+ 1 ) 


P2A min {a ,M^-i ,M2- j }dt 






(i+ 1 , j+ 1 ) 


p^2^ min {a ,Mj^-i , M2- j }dt 






(i- 1 / j ) 


min {R^ , i}dt 






(i/ j- 1 ) 


H2 min {R2 , j }dt 



{ ( t ) , X 2 ( t ) ; t ^ 0} is a finite state space continuous- 
time-Markov process. All states of the process, defined by 
(2.16), comraunicate , so the Markov process is irreducible. 

Hence, by Theorem (2.1), the limiting distribution exists, 
and can be found by solving a system of linear equations. The 
parameters of the process are given by: 

f(i,j) = 1 min {a,Mj^-i,M 2 ~j } 

/ i ~ l,2,...,Rj^~l 

( i r j ) = I 

( i = / . . . (2.17) 

/ ^2^ D 1/2,..., R 2 “ 1 

= ! 

^ 2^2 ^ ^2 ^ * * * ^^2 

To achieve the objectives of this chapter, three differ- 
ent formulations for the Two-Modules Logistics problems will 
be presented. 
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X2(t) 



Number of modules 
down of Type 2 



X, (t) = Number of modules 
down of Type 1 



Figure 2.2- Schematic of the Two-Fodules Logistics System 
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instantaneous cannibalization, so that one aircraft will not 
be awaiting a Type-1 module only, while another aircraft 
awaiting a Type-2 module only. A Type-1 module can be canni- 
balized from the latter aircraft and installed on the former 
aircraft resulting in one aircraft operational. 

Finally, it is assumed that repair in both shops is 
Markovian (or exponential) where and IJ 2 denote the repair 
rates at which individual repairs of Type-1 and Type-2 
modules, respectively, are completed. Figure (2.2) shows a 
schematic of this system. 

Once (t) and X 2 (t) are known, then the number of modules 
of both types in any category can be determined from the 
Markovian assumptions. 

(i) The number of modules operating is min{a,M,-X, (t) , 
M2~X2(t)} 

(ii) The number of spares of Type i is max{0,M.-X. (t)-a}, 

i = 1,2 ^ ^ 

(iii) The number of modules in repair at shop i is 
min{R^,X^ (t) } , i = 1,2 

(iv) The number of modules of Type i waiting for repair 
is max{0 ,X^ (t) -R^} , i = 1,2 

Thus the number of modules in any category can be determined 
once X^ (t) , i = 1,2, are known. 

The transition probabilities of the process {X^^ (t) ,X 2 (t) ; 
t ^ 0 }, of order dt are given below: 
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result of incorporating the warning time, and considering the 
new parameters for the process. 

Under both classes of the surprise scenarios, we 
were able to compute the readiness of the squadron measured 
in terms of the initial distribution for the number of aircraft 
ready to engage in combat. 

G. TWO-MODULES PROBLEM FORMULATION 

Consider an aircraft squadron that consists of a number, 
a, of failure-prone aircraft. Each aircraft requires each of 
two modules (e.g., an engine system, and an avionics system) 
to be considered mission capable. Let p^^ , P2 and p.^2 the 
conditional probabilities that, when an aircraft is reported 
down, it requires respectively. Type 1 , Type 2 , or both types 
of repair, where p^^ "*■ ?2 t P12 “ ^ denote the overall 

Markovian failure rate of an aircraft. Suppose that there are 
Mj^ and M2 modules of Type 1 and Type 2 respectively assigned 
to the organization, where min{M^^,M2} ^ a. Furthermore there 
are and R2 repairmen (crews) capable of repairing modules 
of Type 1 and Type 2 , respectively,, and only one repairman 
(crew) can work on a failed module at any time. 

Let (t) and ^2 (t) denote the number of modules of Type 
1 and Type 2 that are awaiting or undergoing repair at time t. 
Thus the number of mission-capable aircraft is min{a,M^-X^ (t) , 
M2“X2(t)}. This is the number of aircraft that are failure 
prone; the others are awaiting either a module of Type 1 and/or 
a module of Type 2 . This formulation tacitly assumes 
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Thus P{X(W) = j ,X (0) 



1 



W} is given by 



j 

i 


0 


1 


2 


3 


4 


5 


6 


0 


.0414 


. 0566 


.0683 


.0686 


.0576 


. 0514 


.0237 


1 


.0142 


. 0614 


.0740 


. 0743 


.0624 


. 0556 


.0257 


2 


. 0043 


. 0185 


. 0407 


. 0410 


.0344 


. 0307 


.0142 


3 


. 0011 


. 0047 


.0103 


.0154 


.0130 


. 0115 


.0053 


4 


. 0002 


. 0010 


.0021 


.0032 


.0038 


.0034 


.0016 


5 


0 


.0002 


.0006 


. 0007 


. 0008 


. 0010 


. 0006 


6 


0 


0 


.0001 


. 0001 


.0001 


. 0001 


. 0001 



Therefore , 



6 ~ 

P{X(W) = jlw} = I P{X(W) = j,X(0) = i|w} 

i=0 



which is given by the following table: 

State :j =0 1 2 3 4 5 6 

p{X(W) = jlw} = .0612 .1424 .1961 .2033 .1721 .1537 .0712 

The readiness probability distribution becomes: 

Number of aircraft :j =0 1 2 3 4 

P{D(0) = j} .0612 .1424 .1961 .2033 .3970 

Note that the median number of aircraft ready to engage has 
improved to approximately 3; and the expected number of air- 
craft ready to engage has improved to 2.7325. This is a 
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i 


0 


1 


2 


3 


4 


5 


6 


0 


.6748 


.9240 


1.1146 


1.1209 


.9404 


.8383 


. 3869 


1 


.2310 


1.0011 


1.2075 


1.2143 


1.0188 


.9082 


.4192 


2 


.1393 


. 6037 


1.3313 


1.3389 


1.1233 


1.0013 


.4622 


3 


.1051 


.4554 


1.0042 


1.5127 


1.2692 


1.1314 


. 5222 


4 


.0882 


. 3821 


. 8425 


1.2692 


1.4843 


1.3232 


. 6107 


5 


.0786 


. 3406 


.7510 


1 .1314 


1.3232 


1.6252 


. 7501 


6 


. 0725 


.3144 


.6932 


1.0443 


1.2214 


1.5002 


1.1539 



Therefore the E[P. . (W) ] is: 

^ r 3 



i X 


0 


1 


2 


3 


4 


5 


6 


0 


.1125 


.1540 


.1858 


.1868 


.1567 


.1397 


.0645 


1 


.0385 


.1669 


.2013 


.2024 


. 1698 


.1513 


.0698 


2 


. 0232 


.1006 


.2219 


.2232 


.1872 


.1669 


.0770 


3 


. 0175 


. 0759 


.1675 


.2521 


.2115 


.1885 


.0870 


4 


.0147 


.0637 


.1404 


. 2115 


.2474 


.2205 


.1018 


5 


.0131 


.0568 


.1252 


.1886 


.2205 


.2708 


.1250 


6 


.0121 


.0524 


.1155 


.1741 


.2036 


.2500 


.1923 



Hence , 



P{X(W) = j,X(0) = i|w} = P{X(W) = j|X(0) = i,W}P{X(0) = i} 



= P . . (W) TT . 

i/D 1 
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state: i=0 1 2 3 4 5 6 

7T(i) = .3676 .3676 .1838 .0613 .0153 .0038 .0005 

Then using equations (2.8), we can compute the 
squadron readiness probability distribution. This was found 
to be : 



Niamber of oper- 
ational aircraft: j 

P{D(0) = j} 



0 


1 


2 


3 


4 


3676 


.3676 


.1838 


.0613 


. 0196 



This means that under the total surprise scenario, 
the probability of the squadron having no aircraft ready to 
engage the incoming threat is .3676, the probability of having 
one aircraft operational is .3676, and the probability of having 
two aircraft operational is .1838, etc. Note that the median 
number of aircraft ready to engage is less than 1; and the 
expected number of aircraft ready to engage is .9387 aircraft 
which is also less than 1. This suggests that the squadron 
must prepare for combat in order to survive, 
b. Partial Surprise 

The Laplace transform P. . (n) was found to 

1 f 3 



be : 
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n 



0 £ j < a 



P{D(0) = j] 



M 



I T (n) 



i=0 
M M 



k=a 1=0 ' 



3 = a 



otherwise 



(2.15) 



2 . An Illustration for the Single-Module Logistics Model 

The following basic data and assumptions were used as 

an example for the Single-Module Logistics model illustration: 

An aircraft requires one type of module to be considered 
as a mission capable aircraft. 

- The squadron is assigned a = 4 aircraft. 

The total number of modules assigned to the squadron 
is M = 6 . 

The maintenance commander is assigned 2 repairmen 
(crews) . 

An aircraft is reported down at a rate of X = 1 aircraft 
per day, during peacetime, and becomes X' = 0.5 aircraft 
per day, during the warning time, if a partial surprise 
scenario is considered. 

Modules are repaired at a rate of y = 0.5 modules per 
day during peacetime, and y ' = 1 module per day during 
the warning time if a partial surprise scenario is 
considered . 

The expected time for the warning period (i.e., time 
until the attack) is ri"^ = 6 days. 

For illustration, both classes of surprise attacks 

will be considered. 

a. Total Surprise 

The limiting distribution for the number of 
modules up was found to be: 
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From the law of total probability. 



M ~ 

P{X(W) = j|W} = I P{X(W) = j,X(0) = i|w} 

i=0 



M ~ - 

= I P{X(W) = j|x(0) = i,W}P{X(0) = i} 
i=0 



Thus : 



M ~ 

P{X(W) = j|w} = [ TT.P{X(W) = j|x(0) = i,w} (2.13) 

i=0 ^ 



Taking the expectation of both sides of (2.13) 
with respect to W, we obtain the following: 



M ~ - 

E[P{X(W) = j|W}] = [ tt.E[P{X(W) = j|X(0) = i,W}] 

i=0 ^ 



Using equation (2.11), we get: 



M C 

E[p{x(w) = j|w}] = n I TT.p. .(n) (2.14) 

i=o ^ 



Hence, the readiness probability distribution is 



given by: 
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so that the required readiness is given ^ terms of a Laplace 
transform. 

Taking the Laplace transforms of (2.10) and inte- 
grating by parts yields: 


















( 2 . 12 ; 



i < j < M-1 






where : 



= I 



1 if j = i 
0 otherwise 



The readiness probability distribution can be 
calculated by solving for P{X(W) = j|W}, j = 0,1,..., a, from 
the above system of linear equations using (2.11) together 
with the initial distribution for the restricted process 
{X(t) , t ^ 0} given by (2.9) . 
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dp. Jt) 

i,H 

dt 















( 2 . 10 ) 



3t''l,o‘'=> = 



* H'’i 



Let P. .(s) be the Laplace transform for P. . (t) 
1 / D 1 ? D 



h,:‘=' = /, 



e P. . (t) dt 
IrD 



To find the readiness probability distribution at 
the time of attack, it is required to find the probability 
distribution for the number of modules available at the time, 
of attack. Let 

P. ^ (W) = P{X(W) = jjX(O) = i,W} 

Now note that 



E[P. .(W)] 
1 / J 



OO .X. CO 

/ P- p;(a3)Tie ’^‘*^do3 = n J e ’^“p. .(cjj)doj 

0 0 



E[P. . (W) ] 

1 f J 






(n) 



( 2 . 11 ) 
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Let X(t) be the number of modules available at 
time t with the new rate parameters. Therefore, the 
{X(t) , t ^ 0} is a continuous-time-Markov process with the 
following rate parameters: 



I X'i for i = 0,l,...,a-l 
= A' xmin{a,i} = ! 

' A ' a for i = a , . . . ,M 



and 



/ y'R for i = 0,1,..., M-R 

= y' xmin{R,M-i} = 

( y'(M-i) for i = M-R+1 , . . . ,M 

The initial condition for {X(t) , t ^ 0} is the 
limiting distribution for {X(t), t ^ 0}, i.e., set of equations 
(2.7) . 



P{X(0) = i} = 7T^ i = 0,1,2, ...,M (2.9) 

Therefore, {X(t) , t ^ 0} is a birth-and- death 
process with initial conditions for i = 0,1,..., M. Let 

P. . (t) = P{X(t) = j |X(0) = i} 

1 ' J 

The forward Chapman-Kolmogorov equations for 
{X (t ) , t > 0 } are : 
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Let D(0) 



Number of interceptors ready to engage in 
combat at the time of attack. 



Then : 

IT . for 0 < j < a 

M 

'l TT . for j = a (2.8) 

i=a ^ 

0 otherwise 

This assumes that attacks occur infrequently, so a steady- 
state distribution prevails, and that there is essentially no 
warning . 

b. Partial Surprise 

Suppose that the intelligence data analysis indi- 
cates that the enemy might strike after W units of time (e.g., 
days) . Assume that W is a random variable distributed exponen- 
tially with mean n During such a time period the squadron 

will undergo a mobilization and preparedness stage, and the 
squadron activities will change. They will eliminate training 
and conduct air reconnaissance and early warning missions 
only, and they will change (enhance) the maintenance repair 
capability. Such changes are assumed to cause the failure 
rate to decrease and the repair rate to increase. 

Assume that the failure rate decreases from A to 
A' where A > A', and that the repair rate increases from y to 
y ' where y < y ' . 



P{D(0) = j} = 
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the repair policy implemented, the number and types of test 
and diagnostic equipment, and the supply of spare parts. 

Finally, the quality of facility management is an intangible 
influence . 

The operational factors include the number of aircraft 
assigned to the squadron, the number and skill of the pilots, 
the effectiveness of the training programs, and the sensitivity 
of the early warning system. 

The intelligence factors include: 

(a) The procedures used in collecting information about 
the enemy movements including the prediction of 
enemy actions based on current political status. 

(b) Quality of the analysis of the information collected 
and the confidence of the decision makers in the 
conclusions reached. Information could indicate the 
intention of the enemy, however the defender sometimes 
fails to anticipate surprise attacks. 

The effect of surprise is reduced as the readiness in- 
creases. Surprise attack can be classified in different 
stages as: (Brodin, 1978) 

(1) Total surprise, 

(2) Partial surprise, 

(3) No surprise. 

In an attempt to model the surprise phenomena mathematically, 
the following warning scenario was considered. 

1 . Models for Readiness: Stages of Surprise 

a. Total Surprise 

Under the Single-Module-Logistics formulation, if 
a total surprise phenomenon is considered, then a readiness 
distribution model can be derived as follows: 
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B 



7T 



0 



M-1 




— ^ 1 < i < M-1 (2.7) 

TT X . n y . 

j=l ^ j=i ^ 



where : 



M 



B 



M 

n 

j=i 






B = 



-1 



1 


M-1 

+ y 




1 


+ 1 


M-1 


^ z 


i 


1 — 1 
1 


M 


•1 


i=l 


n 


A . n y . 


n 


j=o -I 




j=i 


3 j = i 0 


1 — 1 
II 



Readiness ; 

The factors affecting the combat readiness of an inter- 
ceptor squadron can be categorized as : 

Factors that are related to the logistics system. 

Factors that are related to the operational system. 

Factors that are related to the intelligence or warning 

system. 

The logistical factors include the number of spare modules 
authorized to keep on base, the number of maintenance per- 
sonnel assigned to the maintenance organization, the skill 
and level of training of maintenance personnel, together with 
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1 



a 



i(M-R-l) ^0 




1 



Thus : 



TT 



0 




i -1 



( 2 . 6 ) 



Therefore, the limiting distribution can be calculated by 
determining tTq first using equation (2.6), and then applying 
equation (2.5) to calculate the limiting probabilities 
recursively . 

Approach 2 ; 

Another approach to computing the Hj's is to view the 
system as a closed migration process. Kelly (1974) shows 
that a closed product form can be derived for the equilibrium 
distribution . 

The flight line and the repair shop can be considered as 
stations between which the modules move. Assume that modules 
cannot leave or enter the system, and that the total number 
of modules in the system, M, is fixed. Then, X(t) is a cyclic 
queue, where a module departing from one station joins the 
other with probability 1. 

Using Kelly's results for a closed migration process, we 
get the following expressions for the limiting distribution: 
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0 



~A 7T + )J 1 IT., T 
M M M-1 M-1 



-yO^To + = 0 



(2.4) 



-(X.+y.)7T. + y. ,iT. , + A.,,7r.,, = 0 

: j 0 j-1 :-i :+i d+i 



Below are given alternative methods for calculating tt ^ . 
Approach 1 ; 

The finite-state-continuous-time Markov process 
{X(t), t ^ 0} has been shown to have a limiting distribution. 

From the set of equations (2.4), n ^ can be written recur- 
sively as: 



TT . 

1 



I iA ^i-1 
I (M-i 



for i = 1,...,M-R-1 



(2.5) 



, IT. , for i = M-R,...,M 
3. A 1 “ J- 



Therefore ; 



-^(^) tt 
i! ^ A ■' 0 



for i = 1 , . . . ,M-R-1 



TT . 
1 



R1 



i R 



M-R 



( M-li!al <X> ai-(M-R-l) 0 



TT„ for i =M-R, . . . ,M 



M 



and ^ IT . = 1 . 
i=0 ^ 



Hence 



M-R-1 M 

7^,^+ y 1T.+ y TT. = 1 

• -t 1 . h 1 



i=l 



l=M-R 
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F. LIMITING DISTRIBUTION 



All states of the Markov process defined by (2.1) communi- 
cate so the Markov process is irreducible. Hence the limiting 
distribution exists and is independent of the initial condition. 
Since every state is a positive recurrent state, the limiting 
values are all positive and form a probability distribution. 

This results from the following theorem (Bhat, 1984): 



Theorem (2.1) 

(1) If the Markov process is irreducible then the limiting 

distribution lim P.(t) = tt . exists and is independent 
t^oo D 3 

of the initial conditions of the process. The limits 
{iTj, j e S}, where S is the state space, are such that 
they either vanish identically (i.e., = 0 for all 

j e S) or are all positive and form a probability 



(2) 



distribution (i.e.. 

The limiting distribution {it 



TT . > 0 for all j 
3 



S, I 

j eS 



TTj = 1) . 



j' 



j e S} of an irreducible 



positive recurrent Markov process is given by the unique 
solution of the equation ttQ = 0 , and I = 1, where 



V 

i,€S 3 



Q is the infinitesimal generator for Me process, and 



TT (7rQ,7[^,...). 



Let TTj denote the long-run probability of the process 
being in state j. Therefore: 



IT 



j 



lim P . ( t ) 
t^-oo 3 



From the above, as t 
forward Chapman-Kolmogorov 



J 

«>, Pj (t) ^ 0, therefore 
equations (2.2) become: 



the 
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Subtracting (t) from both sides and dividing by dt and 
letting dt tend to zero results in the following: 



dPj (t) 
dt 



since 



o(dt) 

dt 



0 as dt 0. With the initial condition: 



j 1 if j = M 

^ 0 otherwise 



the forward Chapraan-Kolmogorov equations are: 



dt 



''' ^M-l^M-1^^^ 



dPQ(t) 

dt 



•yQPQ(t) + X^P^(t) 



( 2 . 2 ) 



dPj (t) 
dt 



U.+M.)P.(t) + yj_iPj_i(t) + 



1 < j < M-1 



with the initial condition: 



Pj(0) = 



1 if j = M 



0 otherwise 
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state space {i = 0 , 1 , 2 , . . . ,M} . The parameters of the process 
are given by: 



Ai for i = 0,1,2 



f • • • f 



a-1 



X . = X xmin{a, i} 
1 



Xa for i 



M 



and 



for i = 0,1,2 



M-R 



= y xmin{R,M-i} 



y X (M-i) for i = M-R+1 



A • • • / 



M 



Let Q be the infinitesimal generator for the Markov process 
{X(t) , t ^ 0}. Then Q will be given by the matrix on the next 



process being in state j given that it started in state i. 



The forward Chapman-Kolmogorov equations are derived by 
writing the probability that the process is in state j at 
time d+dt as a function of the state probabilities at time 
t. The probability of being in state j at time t+dt is 
expressed by: 




Then (t) = P{X(t) =j|x(0) = i}. To simplify the notation 
we suppress the initial conditions and write, 





Pj(t4dt) = (l-(Xj+yj)dt)Pj (t) + y^_j^dtPj_j^ 




(t) + o(dt) 
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Flight Line 



Capacity = a air- 
craft 

Failure rate = X 



spares 

^ 1 . 



X(t) = Number of available modules 



Repair Shop 



Waiting for 
Repair 




Capacity = R 
Repair Rate = y 



V. 



V 

Number of modules 



"down" 



Figure 2.1. Schematic of the Single-Module 
Logistics System 
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is assumed that repair is Markovian (or exponential) , where n 
denotes the rate at which an individual repair is completed. 

Figure (2.1) shows a schematic of the above system. Karlin 
and Taylor (1984) have analyzed the above problem and have 
shown that once X(t) is known, the number of modules in any 
category can be determined. A module can be in any of four 
states : 

(i) Operating (installed on aircraft). 

(ii) "Up" but not operating, i.e., a spare. 

(iii) Under repair. 

(iv) Waiting for repair. 

Each of the modules down at time t must either be undergoing 
or awaiting repair. Thus: 

(i) The number of modules operating is min{a,X(t)}. 

(ii) The number of spares is max{0 ,X (t) -a) . 

(iii) The number of modules in repair is min{R,M-X (t ) } . 

(iv) The number waiting for repair is max { 0 ,M-X ( t ) -R} . 

The number of modules in any category can therefore be 

determined easily once X(t) is known. 

The transition probabilities of the process {X(t), t ^ 0}, 
of order dt are given below; 



t 




t+dt 


Probability 




i 




i+1 


\i min{R,M-i} 








i-1 


X min{a,i} 


(2.1) 


The 


above 


assumptions and 


formulation specify the 


stochas- 



tic process {X(t), t ^ 0 } as a birth-and-death process with 
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may experience either simultaneous or independent demands for 

two types of repair, depending on the case under consideration. 

Let the number of modules of type i, i = 1,2 for repair at time 

tbe {X^(t), t^O, i=l,2}. Then the bivariate vector having 

components Xj^(t) and X 2 (t) can be considered to be the state 

of the system at time t. If full cannibalization is allowed, 

then Xj^(t) and X 2 (t) determine the number of aircraft operational 

As is true for the univariate case, this process may be modelled 

as a bivariate-continuous-time Markov process. More generally, 

if we have a multi-module, e.g., K-module, setup, the process 

t h, 

could be modelled by a -variate-continuous-time Markovian 
process . 

E. SINGLE -MODULE PROBLEM FORMULATION 

Consider an aircraft squadron that consists of a number, a, 
of failure-prone aircraft. Each will be considered not mission 
capable if, and only if, a specific module is not working. Let 
A denote the overall Markovian failure rate of an aircraft, 
where failure of an aircraft means a failure of the module it 
currently carries. Suppose that there are M modules assigned 
to the organization where M ^ a, and there are R repairmen 
capable of repairing the modules, and only one repairman is 
required to repair a failed module. 

Let X(t) denote the number of modules that are installed 
or available at time t. Thus the number of mission capable 
aircraft is min{a,X(t)}, which is the number of aircraft that 
are failure-prone, the others awaiting a module. Finally, it 
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C. SCOPE 



An air interceptor squadron is selected to represent the 
logistical situation under study. The squadron is considered 
to be assigned a number, a, of aircraft. The study concen- 
trates on finding the readiness of the aircraft at the time 
of attack by enemy bombers. This readiness depends upon the 
total number of each module type and the number and rates of 
repair characteristic of the repairmen in each shop. In turn, 
the readiness that results influences combat effectiveness. 

D. APPROACH 

To achieve the above objective, the logistics system of the 
squadron during a "peacetime" (noncombat) situation must be 
analyzed. The repair shop experiences demands for repair, 
depending on the type of problem under study. If the problem 
formulation considered assumes that the whole aircraft is a module, 
then the shop experiences a single type of demand for repair. 

Let the number of modules up at time t be {X(t), t ^ 0}; 
under Markov conditions the variable X(t) can be considered to 
be the state of the system. Because of the random nature of 
the system state change, the process (X(t); t ^ 0} represents 
a stochastic process. By introducing certain reasonable assump- 
tions that will be stated later, the process can be modelled as 
a continuous-time Markov process. 

However, if the problem under study assumes that an aircraft 
requires each of two types of modules to qualify as a mission 
capable aircraft, then the two-shop maintenance organization 
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gave a good approximation to long-run aircraft availability 
when compared with simulation model results. Their work tends 
to validate the use of a convenient approximate model (diffu- 
sion) for decision making. 

The single-type module repairman problem is presented first 
in this chapter followed by the two-type module repairman prob- 
lem. After discussing the objectives of this chapter, the 
models for the various types of problems will then be constructed 
followed by sample solutions. The probability distribution 
function for the interceptor squadron readiness will be calcu- 
lated. Those results will then be used in Chapter V for the 
blending of the logistics and combat models. 

B. OBJECTIVE 

The objective of this chapter is to formulate and analyze 
the generalized repairman problem for the maintenance organi- 
zation of an interceptor squadron. Analysis of the repairman 
problem means determining the various factors affecting the 
repair process in the organization. A major factor is the 
number of different types of modules requiring different types 
of repair facilities and different repair times. This chapter 
analyzes the following repairman problems: 
a single type of module. 

two types of modules with independent failure rates. 

two types of modules with dependent failure rates, with 
the probability of a simultaneous failure of both modules 
being negligible. 

two types of modules with a non- zero simultaneous 
failure rate. 
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needs to be determined. The repair policy represented by 
the vector y recommends that: whenever the system is in 

state n take the decision y (n) , (e.g., if in state 1 then 

take decision 1, if in state 5 take decision 3, etc.) . Now, 
to determine the corresponding infinitesimal generator Q, 
we use the following algorithm: 



For: n = 1, (Mj_+1) (M^+l) 

Q(n,m) = Q^^^^(n,m) m=l,..., (M^+1) (M 2 +I) . 



The preceding discussion for determining Q will be clearer 
when the infinitesimal generator Q* for the optimal policy 
is determined. 

Note that the policy decision is made potentially at 
each state change. 

In an attempt to search for the most favorable (i.e., 
optimal) policy that needs to be followed in order to maxi- 
mize the readiness of the squadron we maximize the expected 
number of aircraft ready to engage in combat. Table 3.2 
shows the total number of aircraft ready to engage (f (n) ) 
for the various states of the process. 
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TABLE 3.2 



NUMBER OF AIRCRAFT OPERATIONAL WHEN 
THE PROCESS IS IN STATE (I,J) 





state: 

n 


state: 
(ir j) 


No. of Aircraft 
f(n) 



1 


(0,0) 


2 


2 


(0,1) 


2 


3 


(0,2) 


1 


4 


(0,3) 


0 


5 


(1,0) 


1 


6 


(1,1) 


1 


7 


(1,2) 


1 


8 


(1,3) 


0 


9 


(2,0) 


0 


10 


(2,1) 


0 


11 


(2,2) 


0 


12 


(2,3) 


0 



K. RESULTS AND ANALYSIS 

1 . Steady State Analysis 

For any policy the long-run expected number of air- 
craft that are up and ready to engage per unit time, E[D{<»)], 
can be calculated by multiplying the number of aircraft up 
when in state n (f (n) ) by the long-run (limiting) probability 
of being in state n and summing over all possible states. 
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E [D(oo) ] 



(Mj_ + 1) (M 2 + I) 

I f (n) TT^ (Y) V Y 



12 

E[D(c»)] = I f(n)Wj^(Y) V Y 

n=l 



where : 



(y) f f ^ represents the steady-state 

distribution of the state of 
the system under the policy 
being evaluated. 

The state space consists of only 12 states. 

Since all states communicate, the process is a 
regular Markov process. Therefore the limiting probabili- 
ties exist. The resulting optimal policy is dependent on 
the number of aircraft, modules of Type 1, modules of Type 
2, and repairmen assigned to the base. 

2 . Optimization Results 

a. Linear Programming Results 

The results of applying the linear programming 
optimization approach using the LINDO package are shown 
below in Table 3.3. The resulting optimal policy is shown 
immediately following Table 3.3. 

This optimal policy recommends assigning no 
repairmen to Shop 1 when there are no items of Type 1 down, 
assigning one repairman to Shop 1 when there is an item of 
Type 1 down, and assigning two repairmen to Shop 1 when there 
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TABLE 3 . 3 



LINEAR PROGRAMMING RESULTS 



^od) 


= 


.1180 


Uq(2) 


= 


. 0990 


tTo(3) 


= 


.0511 


Uq( 4 ) 


= 


.0105 


713 ( 6 ) 


= 


. 2739 


773 ( 6 ) 


= 


.1536 


77^ (7) 


= 


.0454 


7T3 (8) 


= 


.0120 


7 T 3 (9) 


= 


.1629 


773 ( 10 ) 


= 


.0534 


773 (H) 


= 


.0179 


773 ( 12 ) 


= 


.0023 



123456789 10 11 12 

State (0,0) (0,1) (0,2) (0,3) (1,0) (1,1) (1,2) (1,3) (2,0) (2,1) (2,2) (2, 
Decision 000032113222 

are two items of Type 1 down. The remaining number of 
repairmen are to be assigned to Shop 2 if there are items of 
Type 2 down or they are idle. Following this policy gives 
an objective function value (i.e., expected number of air- 
craft that are operational) of .9579. This policy determines 
a unique bivariate-continuous-time Markov process with the 
following infinitesimal generator: 
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( 2 , 2 ) 



Therefore, by assigning the repairmen according 
to the optimal policy, the resulting stochastic process 
can be assumed to be a bivariate-continuous-time-Markov 
proces (t) ,X 2 (t) ; t ^ 0}, over the state space 
S = { (0 , 0) , (0 , 1) , (0 , 2 ) , . . . , (2 , 3) } , with the infinitesimal 
generator Q* and initial conditions: 

/I ifn=0,m=0 

m^°'> = I 

n ,m I 

\ 0 otherwise . 

Such a process has the limiting probabilities 
shown in Table 3.3 and an expected momber of aircraft ready 
to engage of .9579. 

b. Dynamic .Programming Results 

The results of applying the dynamic programming 
procedure are given in Table 3.4. The optimal policy is 
shown immediately following Table 3.4. The total objective 
function value = .9579. 

The infinitesimal generator (Q*) for the 
continuous-time Markov process resulting from the application 
of the optimal policy is: 
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TABLE 3.4 



DYNAMIC PROGRAMMING RESULTS 



1 — 1 
00 


= 


.1180 


tt2(2) 


= 


. 0990 


(3) 


= 


.0511 


Uo(4) 


= 


.0105 


tt3 (5) 


= 


.2739 


7T2 (6) 


= 


.1536 


(7) 


= 


.0454 


00 


= 


.0120 


tt3(9) 


= 


.1629 


7T2 (10) 


= 


.0534 


7^2(11) 


= 


.0179 


772 ( 12 ) 


= 


.0023 



The optimal policy is; 

6 7 8 9 10 11 12 

(1,1) (1,2) (1,3) (2,0) (2,1) (2,2) (2,3) 
2 1 1 3 2 2 2 



1 2 3 4 5 

State; (0,0) (0,1) (0,2) (0,3) (1,0) 
Decision; 32103 
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( 2 , 3 ) 



Suppose the squadron is assigned 6 aircraft, 

= 6 modules of Type 1, and M 2 = V modules of Type 2. 

The repair shop supervisor is assigned 6 repairmen, while 
the remaining parameters are the same as in the previous 
example. Table (3.5) gives a summary of the results. 

It shows for every state 'n', the corresponding (i,j) state 
for the bivariate process, the recommended number of repair- 
men to be assigned to Shop 1, and the number of aircraft 
that are up and ready to engage whenever the process is found 
to be in state (i, j) . Following this policy the squadron 
will maintain on the average 2.88 aircraft up at any time. 

L. COMPARISON OF THE DYNAMIC PROGRAMMING AND THE LINEAR 

PROGRAMMING SOLUTIONS 

A comparison of the dynamic programming and the linear 
programming approaches shows that the two approaches yield 
different policies. Table 3.6 shows the results side by side. 

Both approaches gave the same limiting distribution and 
hence the same objective value. The difference in the opti- 
mal policies when (co) = 0} suggests that there is more 
than one optimal policy, i.e., the optimal policy is not unique 
This is intuitively obvious since there is no cost asso- 
ciated with moving repairmen between shops, the assignment 
of idle repairmen to Shop 1 versus Shop 2 doesn't affect 
the objective function value. 

Both approaches resulted in the same infinitesimal 
generator Q*, and since both processes have the same initial 
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TABLE 3 . 5 



A 



SUMIARY OF THE RESULTS OBTAINED BY DYNAJIIC 
PROGPAf'MING RUN FOR* THE 6 AIRCRAFT CASE 






H 


(l.J) 


oecisioN 


AincxArr 


1 


(9.9) 


4. 


4, 


2 


(9*1) 


5. 


4. 


S 


(9.2) 


4. 


5* 


4 


(9*5) 


5. 


4. 


S 


(9*4) 


2. 


5. 


4 


(9.S) 


1* 


2. 


7 


(9*4) 


9* 


1. 


9 


(9*7) 


9. 


9. 


» 


(1.9) 


4. 


5* 


19 


(1*1) 


5. 


5. 


ll 


(1.2) 


4. 


5. 


12 


(1.5) 


5. 


4. 


U 


(1*4) 


2. 


5* 


U 


(l.S) 


1. 


2. 


IS 


(1.4) 


9* 


1* 


u 


(1.7) 


9. 


9. 


IT 


(2*9) 


4. 


4. 


19 


(2*1) 


5. 


4. 


If 


(2.2) 


4. 


4. 


29 


(2.5) 


5. 


4. 


21 


(2.4) 


2. 


5. 


22 


(2.5) 


1. 


2. 


25 


(2*4) 


9* 


1* 


24 


(2.7) 


9. 


9. 


2S 


(5*9) 


4. 


5. 


24 


(5.1) 


S. 


5. 


27 


(5.2) 


4. 


5. 


22 


(5.5) 


5. 


5. 


27 


(5.4) 


5. 


5. 


59 


(5*5) 


5. 


2. 


51 


(5*4) 


9. 


1. 


52 


(5.7) 


9. 


9. 


55 


(4.9) 


4. 


2* 


54 


(4.U 


5. 


2. 


5S 


(4.2) 


4. 


2. 


54 


(4.5) 


4. 


2. 


57 


(4.4) 


4. 


2. 


52 


(4.5) 


4. 


2. 


57 


(4.4) 


9. 


1* 


49 


(4.7) 


9. 


9. 


41 


(5*9) 


4. 


1. 


42 


(5*1) 


5. 


1. 


45 


(5*2) 


5* 


1. 


44 


(5.5) 


5. 


1. 


4S 


(5*4) 


5. 


1. 


44 


(5*5) 


5. 


1. 


47 


(5*4) 


5. 


1. 


4 « 


(5*7) 


9. 


9. 


44 


(4.9) 


4* 


9. 


59 


(4*1) 


4. 


9. 


SX 


(4*2) 


4. 


9. 


S2 


(4.5) 


4. 


9. 


S5 


(4.4) 


4. 


9. • 


S4 


(4.5) 


4. 


C. 


SS 


(4.4) 


4. 


9. 


54 


(4.7) 


4. 


9. 
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TABLE 3 . 6 



RESULTS OF BOTH OPTIMIZATION APPROACHES SIDE BY SIDE 



State 




Decision : 
D-P 


Decision : 
L-P 


(0,0) 




3 


0 


(0,1) 




2 


0 


(0,2) 




1 


0 


(0,3) 




0 


0 


(1,0) 




3 


3 


(1,1) 




2 


2 


(1,2) 




1 


1 


(1,3) 




1 


1 


(2,0) 




3 


3 


(2,1) 




2 


2 


(2,2) 




2 


2 


(2,3) 




2 


2 


distribution, therefore. 


it may be concluded that both 


approaches identified the 


same bivariate 


-continuous- time 


Ma rko V proc ess. 








Observe 


that 


whenever the process is in a state 


(i,j) such that i+j 


< R, 


the optimal decision will always 


be to assign i repairmen 


to Shop 1 and j 


repairmen to Shop 


and any idle repairmen to 


either shop. 


However, if i+j > R 


then a decision has 


to be 


made to determine the number of 


repairmen to be ass 


igned 


to Shop 1 . 
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Consider the state (2,2) . The optimal policy 
calls for assigning 2 repairmen to Shop 1, and a single 
repairman to Shop 2. This shows that the supervisor is giving 
a priority to items of Type 1 since both aircraft are down, 
and only one item of Type 1 is needed to get one aircraft 
up . 

Consider the state (2,3) . The optimal policy 
still calls for the assignment of 2 repairmen to Shop 1, and 
a single repairman to Shop 2. This shows that the supervisor 
must still give priority to items of Type 1, even though an 
aircraft requires both items to be in up condition. This 
is due to the difference in the repair rates, l->j^ = -5 and 
\x^ - 1 module per day. Therefore, it takes two days on the 
average to repair a module of Type 1 and one day to repair 
a module of Type 2. To carry out the analysis mathematically, 
define : 



t h 

U, . = Time to repair the i item of Type 1, 

^ i = 1,2. 

U, = Time required to repair the first item of 
Type 1 . 

= min{Uj^j^ ,Uj^} 

Therefore, i = 1,2 are two independent identically 

distributed exponential random variables with rate . 
Hence : 
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P{u^ > t} 



P{min ,Uj ^2 ) ^ 



P{Uj^j_ > t,Uj^2 > 



> t}p{Uj^2 > 



-ypt -y^t 



-2u^t 



e 



•- e 



e 



Thus: U^ = min{ , Uj ^2 ^ is an exponential random variable 

with rate . In the example, = .5. Therefore the rate 
to get the first item of Type 1, when the process is in 
state (2,3) with 2 repairmen assigned to Shop 1, is 1. 
Therefore, on the average, when in state (2,3) (i.e., all 

modules are down and 2 modules are needed, one of each type, 
to get an aircraft up) , it takes on the average one day to 
get the first aircraft operational. If the supervisor has 
assigned only one repairman to Shop . 1 and 2 to Shop 2, then 
it will take on the average 2 days to get a module of Type 1 
up. By following the above analysis for Type 2 modules, it 
will take on the average 1/2 day to get the first module. 
However, an aircraft requires both types to be considered 
up. Therefore on the average it will take 2 days to get the 
first aircraft up. The preceding analysis supports the deci- 
sion provided by the optimal policy. 



whenever the process is in a state (i,j) such that i+j ^ R 
(R = 3) is trivial. To determine if the resulting repair 



As shown earlier, the decisions to be taken 
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policy is indeed optimal, a Fortran program was written 
to evaluate all possible policies. This is done by 
considering all possible decisions that could be taken 
whenever the process is found in state; (1,3), (2,2), 

or (2,3) . Table (3.7) shows all possible policies, the corres- 
ponding limiting probabilities of the resulting process and 
the objective function value. It is clear that the repair 
policy suggested by both the linear programming and the 
dynamic programming approaches are optimal policies, resulting 
in the same Markov process. 

The linear programming approach has the advantage 

of the widespread availability of commercial packages for 

use (e.g. , LINDO and MPS III) . An additional advantage of 

the linear programming approach is the ability to easily 

conduct sensitivity analyses. However, for large numbers of 

modules, aircraft and repairmen, the linear programming approach 

may be impractical . It seems that the dynamic programming 

approach is more suitable for the larger size problems because; 

It requires less data input and preparation. 

There might be a possibility of degenerate solutions in 
linear programming which will yield an impractical 
optim.al solution (e.g., in the case when there are 
round-off errors in calculating the rates such that 

(M +1) (M_+l) 

I 

j=l ^ 

doesn't equal 1 exactly). 
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TABLE 3 , 7 



ALL POSSIBLE EOETFIVIAL POLICIES 



LJMITIMO 



S 2 
I 2 
I 2 
S 2 
S 2 
: 2 
J 2 
S 2 
: : 
S 2 
S 2 
J 2 
] 2 
i : 
S 2 
: 2 
{ 2 
S 2 

s : 

S 2 
t 2 
i 2 
S 2 
i 2 
I 2 
I 2 



t • ] 2 
I 0 S 2 
1 0 S 2 
I 0 S 2 
IPS? 
10 12 
1 0 S 2 
1 0 : : 
10:2 
1 a s 2 
1 0 s 2 
10 2 2 
1 0 S 2 
10 2 2 
10 2 2 
10 2 2 
10 2 2 
10 2 2 
10 2 2 
10 2 2 
10 2 2 
10 2 2 
10 2 2 
10 2 2 
10 2 2 
10 2 2 



1 0 2 2 0 

1 0 2 2 0 

1 0 2 2 0 

1 0 2 2 0 

1 0 2 2 1 

1 0 2 2 1 

1 0 2 2 1 

102:1 
1 0 2 2 2 

1 0 2 2 2 

1 0 2 2 2 

1 0 2 2 2 

102:2 
1 0 2 2 2 

1 0 2 2 2 

1 0 2 2 2 

112 2 0 
112 2 0 
112:0 
112:0 
112 2 1 
112 2 1 
112 2 1 
112 2 1 
112 2 2 



0.117S O.OVSl 
0.1175 0.0*S2 
0.117S 0.0OS2 
0.1172 0.0*54 
O.llflO 0.0*42 
0.1100 0.0*44 
0.1100 0.0*44 
0.1170 0.0*45 
0.1177 0.0*72 
0.1177 0.0*74 
0.1177 0.0*74 
0.1175 0.0*74 
0.1154 0.0*79 
0.1155 0.0*7* 
0.1155 0.0*00 
0.1154 0.0*7* 
0.1170 0.0*44 
0.1170 0.0*45 
0.1170 0.0*47 
0.1174 0.0*4* 
0.2102 0.0*74 
0.1102 0.0*77 
0.1102 0.0*7* 
0.1100 0.0*00 
0.1100 0.0*07 
0.1100 0.3*00 



0.045* 
0.0440 
0.0441 
0.0442 
0.0470 
0.0471 
0. 0472 
0.0472 

0.04«I 

0.04*4 

0.04*4 

0.0405 

0.0502 

0.0502 

0.0502 

0.0502 

0.04*1 

0.04*: 

0.04*5 

0.04** 

0.04*2 

0.04*4 

0.04*4 

0.0500 

0.0507 

0.350* 



0.0077 
0.0077 
0.0077 
0.0077 
0.007* 
0.007* 
0.007* 
0.007* 
0 . 00*1 
0.09* I 
0 . 00*1 
0 . 00*1 
0.00*4 
0.00*4 
0.00*4 
0.00*4 
0.00*4 
0.00*7 
0 . 00 ** 
0.0100 
0 . 00 ** 
0.0100 
0.0101 
0.0102 
0.0102 
0-0104 



0.27** 0. 
0.27*7 0. 
0.27*4 0. 
0.:7*4 0. 
0.27*4 0. 
0.27*4 q. 
9.27*1 0. 
0.27*: 0. 
0.2742 0. 
0.2742 9. 
0.2740 0. 
0.2752 0. 
0.215* 0. 
0.2140 0. 
0.2442 0. 
0.245* 0. 
0.27*2 0. 
0.27*0 0. 
0.2774 0. 
0.2744 0. 
0.277* 0. 
0.2775 0. 
0.2772 0. 
0.2741 0. 
0.2744 0. 
0.:742 9. 



1520 

1521 

1522 
1524 
151* 
151* 
1540 
1540 
1552 
1552 
1552 
1552 
1557 
155* 
155* 
1557 
1507 
150* 
150* 
150* 
1522 
1524 
1524 
1522 
1524 
1514 



0 . 02*2 
0.02*4 
0.0401 
0.040* 
0.0422 
0.0424 
0.04)0 
0.0424 
0. 044* 
0.0471 
0.0474 
0.047* 
0.0552 
0.9552 
0.0552 
0.0552 
0 . 02*0 
0.02*2 
0.02*4 
0.01*2 
0.040* 
0.0410 
0.0412 
0.041* 
0.0451 
9.9452 



0.00*2 
0.00*4 
0 . 00 ** 
0.00*7 
0.00*4 
0 . 00 ** 
0. 00*5 
0.0102 
0.00*4 
0 . 00 ** 
0.0102 
0.0112 
0.010* 
0.0112 
O.Ollt 
0.0127 
0.00*5 
0 . 00 ** 
0.0204 
0.0114 
0.0101 
0.0105 
0.0111 
0.0120 
0.0111 
9.9114 



0.172* 
0.1724 
0.172* 
0.1714 
0.1712 
0.170* 
0.1702 
0. 14*1 
0.1451 
0. 144* 
0.1445 
0.1425 
0. 150* 
0.150* 
0.150* 
0.150* 
0.1724 
0.171* 
0.1712 
0.1700 
0.14*7 
0.14*2 
0.14*7 
0.1475 
0.1427 
0.1414 



0.041* 0 
0.0415 0 
0.0411 0 
0.04O2 0 
0.9592 0 
9.05*1 0 
0.0504 0 
0.057* 0 

0.0544 0 

0.0544 0 
0.0541 0 
0.0525 0 
0.0444 0 
0.0445 0 
0.0445 0 

0 . 04*4 0 

0.0411 0 
0.040* 0 
0.0402 0 
0.05*4 0. 
0.05*4 0 
0.05*2 0 
0.057* 0. 
0.0570 0. 
0.052* 0 



0174 0.0012 

0171 0.0014 
0144 0.0020 

,015* 0.0041 
0144 0.0014 
0142 0.0017 
012 * 0.0021 
0121 0.0044 
01*5 0.0014 
01*1 0 . 001 * 
01*4 0.0024 

0172 0.004* 
0422 0.001* 
0421 0.0022 
0405 0.902O 
0277 0.0055 
0170 0.0012 
0147 0.0015 
0142 O.OOt* 
0154 0.0Q2* 
0142 0.0014 
0140 0.0014 
0125 0.0021 
012* 0.0042 
01*0 0.0015 



c»»ecTtB 4/c 

0.9424 
0.9420 
0. *427 
0.*414, 
9.9512 
0 . >5 I 7 
0.*521 
0.7514 

0. *54* 

0. *570 
0. *574 
0.*545 
0. *52* 

0. *542 
0.*547 
0.*52« 

0.9422 
0.*42t 
9.9445 
0.*445 
9. *51* 

0. *522 
0.*52« 

0.*522 

0.*572 

LlULI 



2 2 1 0 2 2 1 1 2 2 2 



9.11*0 0.09*0 9.0511 0.9105 0.272* 0.1524 9.0444 0.0120 0.142* 9.9524 0.017* 0.0022 
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IV. FORMULATION AND ANALYSIS OF SOME COMBAT MODELS 



A. INTRODUCTION 

In order to formulate Combat-Logistics models, consider- 
ation of some relevant combat situations are necessary. This 
chapter presents an analysis of an air defense scenario for 
a relatively small country, or, alternatively, an area (or 
sector) of responsibility to a defense system. The air defense 
system is assumed to consist of: 

1. An interceptor squadron made up of a relatively small 
number of aircraft equipped to engage in air-to-air 
combat . 

2. A Surf ace-to-Air system that consists of a number of 
Surf ace-to-Air Missile (SAM) batteries, and Anti- 
Aircraf t-Artillary (AAA) batteries. 

3. An early warning system that has a long range radar, 

and uses information from an airborne warning and control 
system (AWACS) operated by friendly forces. 

4. A command, control and communication (C^) system. 

The air defense system is responsible for defending against 
any hostile air attack from a hostile agent, e.g., nation. 
Suppose that the objective of the air defense system is to 
absorb the initial strike; after the initial campaign it is 
assumed that there will be some support from other friendly 
agents. The term "absorb" means to cause maximum possible 
reduction of the hostile damage to the area being defended. 
Consider the following threat scenario that the air defense 
system might encounter. A hostile attack occurs 
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unexpectedly with multiple bombers; the attack objective is 
to destroy some high-valued military and/or national targets. 

The bombers appear in a wave, i.e., essentially simultaneously. 

It is assumed that the air defense doctrine dictates that 
for any incoming threat, the air interceptor squadron will 
first engage the threat until the threat reaches a certain 
imaginary line (set by doctrine) ; surviving bombers that cross 
the line are attacked by the SAM units. The imaginary line 
will be referred to as the hand-over line , and the term "threat" 
means the enemy bombers. Therefore, the time required by the 
threat to reach the hand-over line from time of detection 
determines the time that is possible for the air interceptors 
to engage the threat. At a later time (or shorter range) the 
SAM units will engage until the threat reaches yet another 
hand-over line, at which point the AAA system will take over 
to engage the surviving threat elements. At each line the 
leakage from the stage before must be dealt with by the system 
in question. Figure (4.1) illustrates the above scenario. 

Notice that each stage constitutes a different type of 
combat; the leakage from that stage provides the input for the 
stage following. For example, the leakage of the air-to-air 
combat process is the input to the SAM-to-bombers engagement 
process (e.g., the number of bombers to be engaged by SAM). 

A feasible enemy doctrine dictates that the mission of 
the bombers is to be aborted as soon as the number of bombers 
surviving the combat drops below a certain number. 
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Figure 4.1. Stages of Air-Defense Combat 



This study presents various models for the air-to-air 
combat process; these models will facilitate the linking of 
the operational logistics models presented in the previous 
chapters to produce the desired combat- logistics models. The 
combat-logistics models allow the decision maker to explicitly 
relate combat outcomes to logistics system scale and organization. 

Some of the relevant measures-of-ef fectiveness (MOE's) for 
the air-interceptor squadron are the following: 

1. The expected number of bombers reaching the first hand- 
over line; this measure is to be minimized. This step 
minimizes the expected number of bombers that will be 
engaged by the SAM units. 

2. The probability that exactly z (z £ B(0)) , or no more 
than z, bombers leak through stage 1. Particular inter- 
est may well be in z = 0 . The above measure is more 
general than the first-mentioned measure, but is also 
more difficult to compute. Diffusion approximations 
evaluate this measure in terms of the mean and variance 
of the leakage at hand-over time. 

3. The duration of the air-to-air combat. Extending the 
combat duration will delay the bombers from reaching 
the first hand-over line. In turn, this will result 
in the bombers burning more fuel, which might result 
in bombers aborting their mission. This MOE in 

turn will also allow the SAM units longer warning 
time to prepare for combat. The manner in which 
air-to-air combat duration can be increased is by 
the range of first detection; which is a factor we 
study in the next chapter. 

The general measure of the effectiveness of the 
air- interceptor squadron that will be considered (modelled 
and optimized) in this study is to minimize the probability 
of penetration of the enemy bombers. Here the term "penetra- 
tion" refers to the ability of the enemy bombers to reach an 
imaginary line (hand-over line) beyond which lies an important 
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defense asset (e.g., SAM units), or beyond which the threat 
will release its load (i.e., bomb-release line). 

Air-interceptor squadrons usually fight with a homogeneous 
set of aircraft. The squadron should be equipped so that it 
is capable of defeating an anticipated threat force. The 
opposing force structure at the beginning of a combat period 
(t = 0) is represented mathematically by the vector (B(0),D(0)), 
where : 



B(0) = The number of enemy Bombers at the beginning 

of the combat period. 

D(0) = The number of Defending aircraft at the 

beginning of the combat period. 

Here the term "combat period" refers to the period during which 
the defenders and attackers (bombers) will meet in combat. It 
effectively begins when the bombers are in the range of the 
defenders. The duration of the combat period can be lengthened 
by extending the warning range. The study assvimes that this 
duration is deterministic. It could be provided by the decision 
maker (e.g., points in time at which the decision maker is 
interested in knowing the opposing force distribution) , or 
could be the time for the bombers to fly from point of detection/ 
intercept to hand-over line. 

B. PROBLEM CHARACTERISTICS 

The study considers two features of the combat situation: 
the early warning process, and the air-to-air combat process. 
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1 . The Early Warning Process 



The early warning process consists of the following 
operations . 

a. Radar Detection of a Hostile Attack 

Radar locates an aerial target in azimuth, range 
and altitude. It then estimates the target course, speed and 
strength (number of attacking bombers) . The radar character- 
istics (particularly range) depend primarily upon the type 
and performance of the radar used, as well as the altitude 
selected for the antenna. 

b. Target Identification 

Identification enables targets to be classified 
in various categories (e.g., friendly, hostile, or unidenti- 
fied) . So a secondary radar which is identif ication--f riendly 
or foe (IFF) — has to be used. 

c. Threat Evaluation 

This phase evaluates a threat index, which depends 

upon : 

The size of the attacking force. 

- Geographical location. 

- The required flight time to the high valued ground 
targets or installations. 

d. Transmission of the Warning 

Warning is transmitted to all air defense units 
(for example, interceptor squadron, SAM batteries, and the 
AAA units) and also to the areas being defended and even the 
civil population (shelters) . 
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Successful execution of the above operations or 

missions is affected by factors such as: 

Radar range; the reliability and maintainability of 
the equipment, including adequacy of spare parts and 
maintenance facility, and equipment calibration. 

Training, skill, motivation, vigilance of the operators. 

- Operational doctrine of the early warning system. 

The availability of, and coordination with, supplementary 
detection system. 

Such supplementary systems include other friendly 
early warning systems in the area, as well as possible infor- 
mation from neighboring allied countries. 

The objective of the early warning system assumed 
for this study is to maximize the time available for combat, 
by detecting the enemy threat far enough in advance to launch 
the air- interceptor squadron, so as to engage the incoming 
threat the longest possible time before reaching their bomb- 
release line. It is assumed that the longer is the available 
time for engagement (combat) , the greater is the likely reduc- 
tion in the incoming threat. 

2 . The Air-to-Air Combat Process 

After detection of the incoming threat, and identified 
as hostile targets, the engagement of targets by the air- 
interceptor squadron requires the following steps, 
a. Scrambling All Operational Aircraft 

The scramble time is measured from announcement of 
the alert to the pilots until take-off. This time consists 
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of the time needed to start the aircraft engines, the time 
required to align the instruments, and the taxiing time, 
b. Target Designation and Engagement 

This step consists of assigning an enemy bomber, 
selected according to its threat index, to the aircraft most 
suited to achieve target interception and destruction. The 
outcome of the engagement is highly dependent on factors such 
as : 



- Defender: Acceleration capability and tolerance, condi- 

tional kill probabilities given a hit, bomber silhouette 
dimensions, and the statistical nature of the projectile 
(missiles and/or guns) versus target range. Skill and 
training of the pilots also has an influence on the 
outcome of the engagement, together with the rate of 
fire that can be achieved by the weapon system. 

- Bomber: Availability and usage of electronic counter- 

measure, accuracy of its defensive air-to-air weapon 
system, the amount of load carried, skill and motivation 
of pilots, and familiarity of pilots with defender's 
tactics . 

The reliability and effectiveness of the command and 
control system, and the skill and training of the ground 
operators . 



C . MODELLING APPROACH 

The complex problem of describing the interaction among 
the different variables, resulting from considering all of 
the preceding combat factors in detail, makes the use of a 
high-resolution combat simulation appear necessary for repre- 
senting the combat process in detail, i.e., at a "micro" 
level. In this chapter we will represent the combat process 
alternatively and at a simple "macro" level by: 
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1. Deterministic (differential equations) models. 

2. Diffusion processes. 

3. Continuous-time-discrete-state Markov process. 

Such representations, as will be seen, allow useful 

calculations to be made analytically. The models do not, 
however, recognize all detailed constraints to which the com- 
bat process is subject. Nevertheless, they, or their exten- 
sions, provide useful guidance to a decision maker. 

The viewpoint taken to obtain macro-level combat models 
is familiar, see Taylor (1983). At any point of time during 
the combat process, a defender aircraft can be found to be 
either (i) engaging an enemy bomber, (ii) free and looking 
for a free bomber, or (iii) killed. Similarly, an enemy 
bomber can be found to be either engaged by a defender aircraft 
or free and trying to avoid being detected or found by defender 
aircraft, or killed. Suppose that we assume fight to the 
finish; that is, once a defender aircraft detects and engages 
an enemy bomber, the one -to- one engagement process will con- 
tinue until either the bomber is killed or the defender air- 
craft is killed. (Note that only one free defender can engage 
a free bomber.) Under this scenario the combat process can 
be represented by the state vector {B (t) ,C ( t) ,D (t) ; t ^ 0} 
where : 



B(t) = The number of enemy Bombers free (and 
alive) at time t, 

C(t) = The number of enemy bombers (in turn 
defender aircraft) in Combat (i.e., 
engaged) at time t. 
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D(t) = The number of Defender aircraft free (and 
alive) searching for a free bomber at time 

t. 

Let be the rate at which an individual defender in 

combat with a bomber kills that bomber (or causes a bomber 

to become ineffective) ; and a be the rate at which an indi- 

B 

vidual bomber, in combat with a defender, kills that defender 
(or causes the defender to become ineffective) . 

Define 6 to be the rate at which an individual free defender 
detects and starts engaging a free bomber, i.e., 0 is the 
re-engagement rate. The units for these variables are given 
below ; 



defenders killed 
(bombers) (time) 

bombers killed 
^D (defenders) (time) 



Q . bombers engaged 

(defenders) (time) 

Note that the total number of bombers alive at time t is 
given by B(t) + C(t), and the total number of defenders alive 
at time t is given by D(t) + C(t) . 

Next, the simplest representations for the variables 
B(t), C(t), D(t) will be presented: the process of mutual 

attrition is taken to be deterministic. 

D. DETERMINISTIC MODELS 

To simplify the representation of the combat process 
analysis, we introduce a deterministic representation of the 
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process by suppressing its randomness. Such a deterministic 
model often, as will be seen later, results in representations 
that deviate somewhat from the expectations of more sophis- 
ticated stochastic process models; such deviations may be 
referred to as the bias of the deterministic model. Usually 
the bias becomes small as B(0) and D(0) increase. 

1. The Finite Re-Engagement Rate Combat Model; (the 
BCD Model) 

First consider the situation described in the previ- 
ous section in which G, the re-engagement rate, is finite. 

3 

The parameter 0 presumably increases if the defense C system 

3 

is improved, but no attempt is made here to model C in a 
detailed manner. 

Define the following functions: 



• b (t) , a representation of the number of bombers 
free and alive at time t, given the initial 
number of bombers and defenders entering combat 
initially . 

• c{t), a representation of the number of bombers 
and defenders engaged in combat at time t, given 
the initial number of bombers and defenders enter- 
ing combat initially. 

d(t), a representation of the number of defenders 
free and alive at time t, given the initial num- 
ber of bombers and defenders entering combat 
initially . 



RESULT (4.1): 



A deterministic model for the above scenario is given by 
the following system of differential equations: 
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db(t) 

dt 


= a^c(t) - 0b(t)d(t) 




dc (t) 
dt 


= 0b(t)d(t) - (ag+aj^)c(t) 


(4.1) 


dd(t) 

dt 


= Uj^c(t) - 0b(t)d(t) 





with initial condition: 



b(0) = B(0) 

c(0) = C(0) = 0 

d(0) = D(0) 



The argument from which the equations is derived is 
as follows. 

The first equation of (4.1) represents the rate of 
change of b(t) with time. The term a c(t) represents the 
expected increase in b(t) caused by a bomber killing a defender, 
while the term 0b(t)d(t) represents the decrease in b(t) 
caused by a free defender detecting and engaging a free bomber. 

The second equation of (4.1) represents the rate of 
change of c(t) with time. The term 0b(t)d(t) is the expected 
increase in c(t) caused by a free defender detecting and 
engaging a free bomber, while the term (ag+aj^)c(t) represents 
the decrease in c (t) caused by a bomber killing a defender, 
or by a defender killing a bomber. 
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The third equation of (4.1) represents the rate of 



change of d(t) with time; the argument used for writing this 
equation is the same as that for the first equation. 

Equations (4.1) can be solved numerically using Runge- 
Kutta method (Gerald, 1984) but not in simple explicit 
closed form. However, a limiting analysis can be as follows. 

Adding the first equation of (4.1) to the second, and 
the third equation to the second of (4.1), we get: 



Define the following: 

b(t) , a representation of the total number of bombers 
alive at time t, and 

d(t), a representation of the total number of defenders 
alive at time t. 



d{b(t) +c(t)} 
dt 




(4.2) 



d{d(t) +c(t) } 
dt 




Then: 



b(t) 



b (t) + c ( t) 



(4.3) 



d (t) 



d ( t ) + c ( t ) 



Substituting (4.3) into (4.2), we obtain: 
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db(t) 

dt 



a 



D 



c (t) 



dd (t) 
dt 



ag c (t) 



(4.4) 



From (4.4), we get: 



a 



B 



db (t ) 
dt 



a 



D 



dd(t) 

dt 



(4.5) 



Integrating both sides of (4.5), we obtain: 



Qg[b(t) - b(0)] = ttg[d(t) - d(0)] , Vt (4.6) 

But from the initial conditions: 

b(0) = B(0) + C(0) = B(0) 

and 

d(0) = D(0) + C(0) = D(0) 

Therefore (4.6) becomes: 

ag[b(t) - B(0)] = ag[d(t) - D(0)] Vt (4.7) 

Since a„ , a„ and c(t) assume nonnegative values, then 
B D 

(4.4) indicates that b(t) and d(t) are both nonincreasing 
functions (as they should be) . 
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a. Criterion for Defenders to Win, BCD Model 

A criterion for the defenders to win can be 
obtained by noting that, in order to conclude that defenders 
won, it must be assumed that b (o°) = 0, and d(«>) > 0. Using 

this assumption, and letting t (4.7) becomes: 

a^d(oo) = a^D(O) - agB(O) (4.8) 

Since , Up., d(«>) are all positive values, then: 

i5 U 

a„D(0) - a^B(O) > 0 

U B 

Therefore, for the assumption that defenders win to be true, 
we must have: 



aj^D(O) > agB(O) 



(4.9) 



Hence, the condition for the defenders to win is 
expression (4.9). If the inequality is reversed, bombers 
win, i.e., some bombers survive. 

Equation (4.8) also shows that: 

ar,D(0) - a„B(0) 

d(oo) = Jd £ (4.10) 

«D 



Therefore, the deterministic approximation for 
the number of defenders eventually surviving combat is 
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independent of the rate of engagement 6 . This is not sur- 
prising, since time extends indefinitely. Of course an equa- 
tion comparable to (4,10) predicts (approximately) the 
expected number of bombers surviving if (4.9) is reversed. 

2 , The Infinite Re-Engagement Rate, Invulnerable 
Defender Model 

To simplify the representation of the combat process 
we can assume an Invulnerable defender's model (I scenario). 
Under the l scenario, we assume that the air defense system 

3 

has a perfect C system represented by having 9 = <», and that 
defenders are invulnerable, i.e., a = 0, and only one-to-one 

JD 

engagement is allowed. 

a. Deterministic Model for I Scenario 

Under the I scenario assumptions, the combat 
process can be modelled deterministically by the following 
differential equation; 



db(t) 

dt 



I -aj^D(O) if b(t) ^ D(0) 

I -a^h{t) if b(t) < D(0) 



(4.11) 



with initial condition: 



b(0) = B(0) 



Equation (4.11) represents the rate of change of 
b(t) with time. At any point in time if b(t) ^ D(0) then all 
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defenders are in engagement (i.e., no free defenders), and 
there are b(t) -D(0) free bombers. This is represented by 
the term aj^D(O). If b(t) < D(0) then all bombers are being 
engaged (i.e., no free bombers), and there are D(0) -b(t) 
free defenders, which justifies the term -aQb(t). 

The solution for equation (4.11) can be derived 

as follows: 

Define : 



t* = inf{t: t > 0, b(t) < D(0)} 



Then, equation (4.11) becomes: 



db(t) 

dt 



I - aj^D(O) for t £ t* 

I - aj^b(t) for t > t* 



(4.12) 



where : 

b(0) = B(0) 

Note that if B(0) £ D(0) , then t* = 0; and the 
solution for (4.12) is given by: 



-at 

b(t) = B(0)e for t > 0 



(4.13) 
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Suppose B(0) > D(0). Then equation (4.12) says 
that there exists a time point, t*, such that for any time 
point t less than t*, 0 £ t £ t*, the rate of change of b(t) 
is -aj^D(O). Recall that only one defender can engage a free 
bomber, so while bombers outnumber defenders, the rate of 
decrease is proportional to the defender numbers. After the 
point t*, b(t) declines below D(0), where its rate of change 
becomes -aj^b(t). 

For t < t* , we have 



db(t) 

dt 



-a^DiO) 



Integrating both sides, and using the initial 
condition, we obtain: 



b(t) = B(0) - aj^D(0)t for t £ t* (4.14) 



For t > t*, we have: 



db(t) ^ 
dt 



-ttj^b ( t ) 



Cot 

Adding aj^b(t) to both sides, multiplying by e , 



and integrating, we obtain: 



(X t cx t * 

e ° b(t) - e ° b(t*) = 0 for t > t* (4.15) 
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From (4.14), we obtain: 



b(t*) = B(0) - aj^D(0)t* , 



-act 

substituting into (4.15) and multiplying by e , we obtain; 



-a (t-t*) 

b(t) = (B(0) - aj^D(0)t*)e for t > t* (4.16) 



Hence, from (4.14) and (4.16), it follows that: 



b(t) = 



. i 



B(0) - aj^D(0)t 



for t < t* 



-a (t-t*) 

(B(0) -a^D(0)t*)e ^ for t > t* 



(4.17) 



From the definition of t*, we have: 



b(t*) - D(0) 



Substituting into (4.17) we get: 



b(t*) = B(0) - aj^D(0)t* - D(0) 



Hence , 

t* - (B(0) - D(0) )/apD(0) 
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Equation (4.17) permits the easy direct computa- 



tion of b(t), the approximation for the number of bombers 
alive at various points of time during the combat period. 

Note that in the preceding analysis we have 
assumed that the force levels are continuous variables. This 
is an assumption that we had to make in order to use the 
above differential equation models to develop deterministic 
representation for the evolution of the combat process. The 
tacit assumption of a deterministic process is perhaps even 
more questionable. Thus, we should develop stochastic analogues 
for the above deterministic models. A natural procedure is 
to utilize diffusion models; see Feller (1971). 

In the development of our diffusion models 
we assume: (i) continuity of the force level variables, 

and (ii) Gaussian increments included in the process. 

We first consider a deterministic model, and then develop 
its stochastic analogue by representing the evolution of the 
combat system by a diffusion process, i.e., as if it evolves 
with independent Gaussian increments. Since the force 
levels (B(t),D(t)) are assumed to be continuous, the 
diffusion mathematics result in a mean and a covariance matrix 
that are approximations to the corresponding matrices that 
would occur if the process was modelled by a continuous-time , 
discrete-state Markov process. However, diffusions often 
yield good approximations with improvements occurring for 
large force level (B(0) ^ <», D(0) ^ °°) . It follows that the 
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diffusion approximation can be used to approximate the MOE 
under study, which requires approximating the probability 
distribution of the number of free bombers at time t. 

E. DIFFUSION MODELS FOR AIR-TO-AIR COMBAT 

Following the arguments in Gaver and Lehoczky (1977a) , 
we now formulate the combat processes resulting from 
modelling the previous scenarios by diffusion processes. 

Since we assume the continuity of the state variables, 
we will, therefore, adopt the following notation; 

B(t) a stochastic diffusion representation for the 
number of bombers free (and alive) at time t, 

C(t) a diffusion representation for the number of 

bombers (hence defenders) in engagement at time t, 
and 

D(t) a diffusion representation for the number of 
defenders free (and alive) at time t. 

1 . Diffusion Model for the BCD Scenario 

Define N to be the total number of aircraft of both 
forces available for combat initially, i.e., N = B(0) + D(0). 

We aim to characterize the air-to-air combat process approxi- 
mately when N -> <», by treating {B ( t ) ,C (t ) , D ( t) ; t ^ 0} as 
a trivariate diffusion process. When N -*- «>, we mean that 
B(0) and D(0) -> «> simultaneously and in a fixed proportion. 

The behavior of the system state vector, {B(t),C(t), 
D(t); t ^ 0}, can be modelled directly by writing it in the 
form of an Ito stochastic differential equation as follows: 
Arnold (1974) 
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dB(t) = agC(t)dt -6B(t)D(t)dt + v'o^CTtTdWj^ (t) 

- /6B(t)D(t) dW2 (t) 

dC(t) = 0B(t)D(t)dt - (ag+Oj^)C(t)dt - C {t) dW^ (t) 

+ /0B (t)D(t) dW2(t) (4.18) 

dD(t) = aj^C(t)dt - 0B(t)D(t)dt - /aj^C(t) dW^(t) 

+/0B(t)D(t) dW2(t) 

where (t) ,W 2 (t) ; t ^ 0} is a bivariate standard Wiener 
process whose components are independent. That is, each com- 
ponent is normally distributed with zero mean and variance 
dt . 

The rationale for writing (4.18) is as follows. The 
dt terms represent the drift or the expected behavior of the 
state variable, [B (t) ,C (t) ,D (t) ] , between t and t+dt. As 
viewed by Gaver and Lehoczky (1977a) , the evolution of the 
process can be considered as being that of a locally Poisson- 
ian process of rate a„C(t), 0B(t)D(t) and a_C(t) for B (t) , C(t) 
and D(t) respectively, with the average output rates being 
0B(t)D(t), (ag+aj^)C(t) and 0B(t)D(t), respectively. 

The term a_C(t) in the first equation of (4.18) 
represents the expected increase in B(t) caused by a bomber 
killing a defender, while the term of aj^C(t) in the third 



183 



equation represents the expected increase in D(t) caused by 
a defender killing a bomber. The term 9B(t)D(t) used in 
equations (4.18) represents the decrease in B(t) (hence D(t)), 
and the increase in C(t), caused by a free defender detecting 
and engaging a free bomber. The variance of the Poisson 
equals the mean, and for large parameter values (in this 
case large number of initial bombers and defenders) the Poisson 
is approximately Gaussian; this heuristically justifies the 
coefficient of the Wiener process terms, and the Wiener terms 
themselves. An increase in B(t) indicates a decrease in the 
total number of defenders alive (D(t) + C(t)); and vice 
versa. This is represented by the coefficients of the Wiener 
processes in the first equation of (4.18) having opposite 
signs than the corresponding terms in the third equation. 

Consider the linear transformation: 



B(t) = Nb (t) + /N (t) 

C(t) = Nc(t) + /N X 2 (t) (4.19) 

D(t) = Nd (t) + /N (t) 



where: b(t), c(t), and d(t) are deterministic functions of 

time, being approximations to the process means which need 
to be determined. {X^(t); t ^ 0}, i = 1,2,3, are stochastic 
elements all of which need to be determined. Justification 
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of such transformations is given by Gaver and Lehoczky (1977a). 
Differentiating (4.19), we obtain: 



dB(t) = Ndb(t) + /N dXj^(t) 

dC(t) = Ndc(t) + /NdX^(t) (4.20) 

dD(t) = Ndd(t) + /N dX^(t) 

Suppose X^(0) = 0, i = 1,2,3. Then from (4.19), we 

obtain ; 



b(0) 

c(0) 

d(0) 



B(0) 

N 



D(0) 

N 



(4.21) 



Let 0 = 0N be constant as N i.e., assume that 

0 is small enough so that 0N ^ constant as N ^ This means 

that on the average a defender takes a relatively long time 
to detect and engage a bomber. 

Now, substituting (4.19) and (4.20) into (4.18), and 
isolating terms of order N and /N and letting N -> <», we 
obtain the following sets of equations. 
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a. Deterministic Equations 

The terms of order N yield: 

agC(t) - eb(t)d(t) 

eb(t)d(t) - (ag+ap)c(t) (4.22) 

a^c (t) - 6b ( t) d (t) 

with initial conditions given by (4.21). 

The solution to these equations, which is obtained 
by numerical integration, provides a deterministic approxi- 
mation to the means of the process. Note that equations (4.22) 
are equivalent to equations (4.1) where, 

b(t) = Nb(t) 

c ( t) = Nc (t ) 

d(t) = Nd(t) 

This shows that the diffusion approximation results in the 
same approximations for the means as the deterministic model. 



db (t) 
dt 



dc (t) 
dt 



dd(t) 

dt 
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b. Stochastic Equations 

The terms of order N yield: 

dXj^(t) = {-ed (t)Xj^ (t)+0gX2 (t)-0b(t)X2 (t) }dt 

+ /UgC (t) dW^ (t) - / 0 B{t)d(t) dW 2 (t) 

dX2(t) = {ed(t)Xj_(t) - (ag+a^)X2(t) + eb(t)X3(t)}dt 

- / (ag+ctj 3 )c(t) dWj^ (t) + /S 5 (t)d(t) dW 2 (t) 

dX3(t) = {-ed(t)X3^(t)+aj^X2(t)-eb(t)X3(t)}dt 

- /o^c (t) dWj_ (t) + /SB{t)d(t) dW^ (t) 

To write (4.23) in a matrix form, let 
x'^(t) = [Xj^ (t) ,X2 (t) ,X^ (t) ] , 

and 

w'^(t) = (t) ,W2 (t) ] 



Then, (4.23) becomes: 



d3<(t) 



-6d(t) 


“b 


-6b (t) 


6d(t) 


-(aB+ao) 


0b (t) 


-Gd(t) 




-6b (t) 



X(t) dt 



+ 



/OgC (t) 

-/ (ag+aj^)c(t) 

(t) 



-/0B(t)d{t) 

/0B(t)a{t) 

/0B(t)d{t) 



dW{t) 



which appears in the form: 



dX(t) = A{t) X(t)dt + V(t) dW(t) 



(4.24) 



where A(t) (a 3 x 3 matrix) being identified as the coefficient 
of (Xj^ (t) ,X 2 (t) ,X^ (t) )*^, and V(t) (a 3 x2 matrix) identi- 
fied as the coefficient of the Wiener process term. 

Now, since X(0) = 0, and b(0), c(0) and d(0) are 
given by (4.21) , then by appealing to the central limit 
theorem, for all t > 0, [X^ (t) ,X 2 ( t) ,X^ (t) ] has a trivariate 

normal distribution with mean 0 and variance-covariance 
matrix Z (t) which satisfies the following differential 
equation; Arnold (1974): 

Z(t) = A(t)Z(t) + Z(t)A'^(t) + V(t)v'^(t) (4.25) 
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Recall that 



B(t) 




b(t) 






C(t) 


= N 


c (t ) 


+ /n 


Xj(t) 


D(t) 




d(t) 




X3(t) 











- - - , 



Therefore, we have obtained the following; 

RESULT (4.2) ; 

{B (t) ,C (t) ,D (t) } is trivariate normal (Gaussian), 
as N (hence, B(0) + D(0)) ^ where B(0) and D(0) “ 

simultaneously and at a fixed proportion; 

{B (t) ,C (t) ,D (t) } ::: Normal (N (b (t),c (t),d (t) ) ,NZ (t) ) 

From Result (2.1), it is possible to estimate 
the probability that at least a specified number of enemy 
bombers are free at time t, which is a useful measure of 
effectiveness (MOE) . 

The deterministic equations (4.22) and the equa- 
tion (4.25) for the covariance matrix E(t) can be solved 
by numerical integration. 

By the required substitution and multiplication 

we get ; 
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V(t)V^(t) = 



agC(t)+ 6 b(t)d(t) 

-/ag{Og+aj^)c(t) 

-eb(t)d(t) 

-/ 5 ^c(t) 

-eb(t)d(t) 



-/ag(ag+Op)c (t) 

- 0 b(t)d(t) 

(06+^0) c(t) 

+ 6 b(t)d(t) 

v''a^Io~+a^) c (t) 
+ 6 b(t)d(t) 



-/a^c it) 
- 6 b(t)d(t) 

/ctp(ag+aJ^)c^t) 

+ 6 b(t)d(t) 

0.^0 (t) 
+ 6 b(t)d(t) 



Writing : 



E (t) 



11 


°12 


Oi 3 (t) 


12 


022(t) 


O23 (t) 


13 


O23 (t) 





Equation ( 4 . 25 ) becomes: 



it 



G(t) S(t) + H(t) 



with initial conditions: 



S( 0 ) = ^ 



where 



S (t) = (a^^(t) 0^2^^^ 023 (t) 0^3 (t) ) 



( 4 . 26 ) 
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G(t) is shown on the next page and H(t) is shown below. 



H(t) 



agC (t) +0b (t)d (t) 

-/ttg (ag+aj^)c (t)-9b(t)d(t) 
-/agaj^c(t) - 0b(t)d(t) 
(ag+ap)c (t)+0b(t)d(t) 

/a^ (ag+ag)c (t) +0b ( t) d (t ) 
ttgC ( t) +0b (t) d (t) 



2 . Diffusion Model for the I Scenario 

Under the I scenario we can characterize the combat 
process approximately when B(0) ^ and D(0) -»■ oo, by 
treating {B(t); t ^ 0} as a diffusion process. 

The Ito stochastic differential equation is: 



-OgD(0)dt - /ogD (0) dW(t) for B(t) > D(0) 
dB(t) = I (4.27) 

-agB(t)dt - /ogB(t) dW(t) for B(t) < D(0) 

Equation (4.27) is written using the rationale used 
for BCD scenario. Let 

D(0) = 6B(0) (4.28) 



where : 



6 is fixed 
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Consider the following linear transformation: 



i(t) = B(0)b(t) + /b( 0) X(t) (4.29) 

Differentiating (4.29), we obtain: 

dB(t) = B(0)db(t) + /bW dX(t) (4.30) 



Substituting (4 . 28) - (4 . 30) into (4.27), we obtain: 



B(0)db(t) 

+v€WdX(t) 



-aj^5 B ( 0 ) dt-/ aj^6B ( 0 ) dW(t) 



if B(0)b(t)+/BT0)X(t) > D(0) = 6B(0) 



(4.31) 



[B (0) b (t) +/B(0)X(t) ] dt-y^ aj^[B(0)b(t)+VB(0rx(t)]dW (t) 
if B(0)b(t)+/BT0Tx(t) < D(0) = 6B(0) 



Isolating terms of order B(0) and /B(0) , and letting 
B(0) 00 , we obtain the following sets of equations, 

a. Deterministic Equations 

The terms of order B(0) yield: 



db(t) 

dt 



I if b ( t ) ^ 6 

1 -aj^b(t) if b(t) < 6 



(4.32) 



193 



Let t* = inf{t: t > 0 and b(t) < 5}, from equa- 
tion (4.32), it follows that: 



db(t) 

dt 



I if t £ t* 

I -aj^b(t) if t > t* 



(4.33) 



Suppose X(0) = 0, then from equation (4.29), we 
obtain the following initial condition: 

b(0) = 1 (4.34) 



For t < t*. 



db(t) 

dt 



-a 



D 



6 






therefore using (4.34), we obtain: 



b(t) = 1 - aj^6t for t £ t* 



(4.35) 



For t > t*, we have, from equation (4.33) : 



db(t) 

dt 




(t) 




Uot 



b(t) } 



0 



194 



Hence : 



e ^ b(t) - b(t^e 


= 0 for t > t* (4.36) 



From equation (4.48), 



b(t*) = 


1 - aj^6t* 



Substituting into equation (4.36), we get: 





for t < t* 


b(t) = 1 


(4.37) 


( (l-ap6t*)e 


-a (t-t*) 

^ for t > t* 



but from the definition 


of t*, we have: 


b(t*) 


- 6 



substituting into (4.37), we get: 



b(t*) = 


1 - Oj^6t* - 6 



Hence : 



ft 

1 > 


- ^ i (4.38) 

ao6 
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b. Stochastic Equations 



The terms of order /B(0) yield: 



dX(t) 



. 1 



-/ap6 dW(t) 



(t ) dt-Za^B ( t) dW(t) 



for t < t^ 



for t > t' 



(4.39) 



For t < t*, from equation (4.39) , we get: 



dX(t) = - /aj^6 dW(t) 



Integrating both sides, we get: 



X(t) - X(0) = -/aj^6[W(t) - W(0)J 



(4 .40] 



Taking the expectation of both sides of equation (4.40), we 
obtain : 



E[X(t)] = 0 

Taking the variance of both sides of equation (4.40), we 
obtain : 



Var (X ( t) ) = ctj^<5t 
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Hence, for t - _< t*, X(t) is normally distributed with zero 
mean and variance aj^6t. 

For t > t*, from equations (4.37) and (4.39), we 

get : 



dX(t) 



-Uj^X (t) dt 




-a 

(l-aj^6t*) e 



D 



(t-t*) 



dW (t) 




t 

X(t) } 




I -a (t-t*) 



dW(t) 



^(t+t*) 

= -/Uj^ (l-aj^6 1*) e dW(t) 



Integrating both sides we get: 



e X(t)-e X(t*) 



(l-aj^6 1*) e ^ 
“d 

t T 

X / s dW(x) 
t* 



Thus , 



X(t) 



-a (t-t*) 

e ^ X(t*) - /aj^(l-aj^6t*) e ^ 



X 



t* 



t 

/ 




T 

dW (t ) 



(4.41) 
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since the function e is a deterministic func- 
tion then it is a nonanticipating function. The function 
g(s) is said to be a nonanticipating function if, for each 
s, g(s) is independent of {W(t) -W(s); t ^ s}; where W(t) 
is a Wiener process with mean zero, and variance t. That 
is, g(s) is independent of the future increments of the 
Wiener process after time s ; Schuss (1980, p. 63). Hence, 
the integral 

t — ^ 

/ e ^ dW (t ) 
t* 



is a stochastic integral (Arnold, 1974) and is a nonantici- 
pating function (Schuss, 1980). 

Now, by appealing to theorem (4.4.2) in Arnold 
(1974), we obtain: 



t 

E[ / 
t* 



UdT 




dW (t ) ] = 0 



(4.42) 



and 






E[{ / 

t* 



t 



dW(T)}^] = 



t 

/ e 



«dT 



dx 



(4.43) 
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It follows from equations (4.42) and (4.43) 



that : 






Var{ / e dW(i ) } 
t* 



1 . 

— le - e } 

“d 



(4.44) 



Taking the expectation of both sides of equation 
(4.41) and using equation (4.42), we obtain: 



-a„ (t-t*) 

E[X(t)] = e ^ E[X(t*)J 



But X(t*) ~ N(0,aj^6t*). Therefore we get 



E[X(t)] = 0 for t > t’ 



Taking the variance of both sides of equation 
(4.41) and using equation (4.43), we obtain: 



Var (X(t) : 



-2aj^(t-t*) 

= e 



-2aD(t-^) ^ a^t a^t* 
Var (X(t*) )+cL^(l-a^6t*)e — [e -e ] 



-2a^(t-t*) 



“d' 



6t*e 



+ (l-aj^6t*) [e 



-Op(t-t*) -2a (t-t*) 

-e ] 



Therefore, for t > t*, we have: 



-2a (t-t*) -a„(t-t*) -a (t-t*) 

X(t) ~ N{0,aj^6t*e ^ +(l-a^^6t*)e (1-e ^ )} 
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We can summarize the above calculations as: 



RESULT (4.3) : 

As B(0) ^ 0 ° (hence D(0) ^ , B(t) is approxi- 

mately normal (Gaussian) . 

B(t) ~ N(B(0)b(t) ,B(0)Var (X(t) ) ) . 

This result can be easily used to compute leakage 
probabilities in terms of D(0) . 

F. A MEASURE OF EFFECTIVENESS: AN APPROXIMATION 

The diffusion approximation results in the same approxi- 
mations for the process means as those given by the solutions 
of the corresponding deterministic models of the previous 
section. It has been shown above that, in addition to develop- 
ing approximations for the process means, we are able to 
derive expressions for approximating the variance-covariance 
matrix of each process. 

Note that the dimension of the system of differential 
equations resulting from the diffusion approximations is not 
a function of the initial size of the forces. For example, 
in the BCD scenario, we need to solve a system of 3 differen- 
tial equations to solve for the deterministic means, and to 
solve a system of 6 differential equations for the variance- 
covariance matrix. This allows military analysts to economi- 
cally model combat processes for larger size problems. It 
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also allows military OR analysts to derive expressions for 
approximating (or estimating) probability statements that 
represent measures of effectiveness (MOE) , and to compute 
their values without expenditure of excessive computer time. 
That is, a useful MOE can be approximated analytically, and 
in near closed form; the results can be used in a program to 
optimize logistics allocations. For example, suppose that 
the MOE, as stated in the introduction to this chapter, is 
to minimize the probability of penetration of at least z free 
bombers. It is assumed that bombers are not capable of 
delivering their load, or their bombs will not hit targets 
defended, when they are being engaged by defenders. Define 
T„ to be the time required for the bombers to reach the bomb- 
release line (or the hand over line). Then B(T ) represents 
the number of bombers penetrating. The above MOE can be 
evaluated mathematically by: 



P(B(Tg)> z1b(0),D(0)} (4.45) 

where the conditional distribution of {B (T ) I B (0 ) ,D (0) } 
given B(0), D(0) is given by Result (4.2) or Result (4.3), 
depending upon the scenario under consideration. 

The diffusion assumes the continuity of the state variables 
it is also dn asymptotic approximation, i.e., it gives good 
approximation as B(0) and D(0) become large simultaneously. 

We can relax these assumptions, and evaluate their practical 
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validity, by formulating the combat process as a continuous- 
time discrete-state Markov process. This will require some 
other assumptions that will be stated in the next section. 

G. MARKOVIAN COMBAT MODELS 

Assume that the engagement time between a defender and a 
bomber is Markovian (i.e., has an exponential distribution). 

That is, a defender takes an exponential time with mean 
to kill a bomber, once an engagement started; and that a 
bomber takes an exponential time with mean to kill a defender 

Assume, further, that the defender takes an exponential amount 
of time with mean 0 ^ to detect and engage a free bomber. The 
air-to-air combat is formulated as a trivariate continuous- 
time-Markov process. Recall that we continue to assume that 
bombers are arriving simultaneously. 

1 . BCD Markovian Combat Model 

Under the BCD scenario, the state of the process is 
represented by the tr ivariate-Markov process {B (t) ,C (t) ,D (t) ; 
t ^ 0} operating on the state space S; where: 

S = { (i, j ,k) : 0 £ i+j £ B; 0 £ j+k £ D; 0 < i+j+k; 

i = 0,1,.. .,B; j = 0 , 1 , . . . ,min (B,D) ; k = 0,1, ...,D}. 

During a small interval of time (t,t+dt] , the state changes 
occur with the following probabilities: 
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t+dt 



Probability 



(i/ j /k) 



(i+1, j-l,k) 



(i, j-l,k+l) 
(i/ j fk) 



fg(i, j ,.k)dt + o (dt) 



(i“l, j+l,k-l) f (i,j,k)dt + o(dt) 



fp(i, j ,k)dt + o(dt) 



1 - f(i,j,k)dt + o(dt) 



(4.45a) 



where for the current model 



fg(i,j,k) = Ugj 



f^(i,j,k) = 9ij 

fj^(i,j,k) = a^j 



(4.45b) 



f(i,j,k) = fg(i,j,k) + f^(i,j,k) + fj^(i,j,k) 



Let, 



^mnL;ijk^^^ = P{B(t) = i,C(t) = j,D(t) = k|B(0) = m, 

C(0) = n,D(0) = £} 



In what follows, for simplicity of notation, we will 
suppress the initial condition, and write: 



i, j ,k 



(t) = 



^ran £ ; i j k ^ ^ ^ 
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Apparently {B (t) ,C (t) ,D (t) ; t ^ 0} is a finite state 
space multivariate death process, as defined by (4.45). 

The forward Chapman-Kolmogorov equations are derived 
by writing the probability that the process is in state (i,j,k) 
at time t+dt as a function of the state probabilities at time 
t. The probability of being in state (i,j,k) at time t+dt 
is, in general, expressed by: 



P 






(t+dt) 



+ fg(l-l,i+l,k)dtP._j^_ +tj,(i,i+l,k-l)dtP._.^^_^_^(t) 

+ o (dt) ; 



the terms on the right-hand side express the mutually exclu- 
sive possibilities: (i) no state change, (ii) the number of 

combats increase by one, (iii) a bomber wins an engagement, 
(iv) a defender wins an engagement. 

Subtracting P. . v(^) from both sides and dividing by 
dt, and letting dt tend to zero results in the following sys- 
tem of differential equations: 






dt = + fc(i-"^'^"^'^-^^)Pi+i,j-i,k+i 



(t) 



+ fg(i ^'^■^^'^^^i-l,j+l,k^^^ fj^(i,j+l,k 



(t) 



(4.46) 
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since ^ 0 as dt 0. If B(0) = B, and D(0) = D, then 



the initial condition is : 






1 if (i,j,k) = (B,0,D) 



otherwise 



Let 






dt 



The forward Chapraan-Kolmogorov equations may be 
written out as follows, starting with the above initial condi- 
tions and recognizing boundary conditions explicitly: 






1 < k < D-1 



^ 1 , 0 , 

1 < i < B-1 



(4.47) 






+ fp(0,j+l,k-l)PQ^j^^^j^_^(t) k,j > 0 1 < k-f-j < D 
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(t) 



+ fg(i-l, j+l,0)P^_j^^ i,j > 0 1 £ i+j £ B 






(t) 



fg(i + fj^(i,j+l,k l)Pi^j+i^k_i 



(t) 



1 _< i ^ B-1 1 £ k £ D-1 

1 < i+j < B-1 1 < k+j < D-1 






(t) 



+ fg(i 



(t) 



1 £ i £ B-1 1 £ k £ D-1 

i+j = B 1 < j+k < D-1 



(4.47) 
(Cont 'd) 



^i,j,k^^^ f^(i+l,j l'J^+l)Pi+i^j_i^k+l 



(t) 



+ fj^(i,j+l,k 



(t) 



1 £ i _< B-1 1 1 k £ D-1 

1 < i+j < B-1 j+k = D 



^i,j,k^^^ f^(i+l,j 



l£i£B-l llk< D-1 
i+j = B j+k = D 
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1 < j < min(B,D) 






(4.47) 
(Cont ' d) 






1 < i < B-1 1 < k < D-1 






1 < k < D 






1 < i < B 



Let P. . . (s) be. the Laplace transform for P. . , (t), 

XfJ/K 



then : 



i k^®^ = / ^ i s > 0 

^ f J r ^ A 



Taking the Laplace transform for P » r^(t) , and using 

o f \J f U 

the initial condition B(0) = B, C(0) = 0, and D(0) = D, we 
get , from (4.45) : 






-f(B,0,D) / e ®^p 

0 



B,0,D 



(t)dt 
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Using integration by parts, it follows that: 



+ ='’b,0,d' = > = = > 



Therefore : 



0 ,D 



s + f (B,0,D) 



Taking the Laplace transform for the general form 

of P. . , (t) in (4.47), we get: 

1 , D , 



P. • 1 (s) 

1,1, k' 



+ f (i,j,k)^^C^^‘''^'^ ^'^■^^^^i+l,j-l,k+l^^^ 



+ fg(i 



(s) 



+ fj^(i,j+l,k • 



(4.48) 



Therefore, we obtain the following system of equations 
for the Laplace transforms: 



^B,0,D^®^ 



s + f(B,0,D) 



^B,0,k^®^ 



iTfm7W^fB(B-l'l'k)PB_i,i,k(s)} 1 Ik <1^1 (4.49) 



Pi,o,o(^) 



s+f (i,0,D) ^ 
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+ *0(00+1, k-l)P„_.^i_^.,(s)} 



k,j > 0 1 < k+j _< D 






= { 



s+f(i,j,0) 



(s) 



+ fg(i-l,j+l,0)P._^^.^^^Q(s)} 

i, j > 0 1 _< k+j _< D 



"i,j,k'=> 



s+f (i,j,k) ^'’^■^^^^i+l,j-l,k+l^^^ 



+ fg(i 



(s) 



+ f^(i,j+l,k-l)P.^.^^^^_^(s)} 



1 < i < B-1 1 < k < I>1 

1 < i+j < B-1 1 < k+j < D-1 



(4.49) 
(Cont 'd) 



"i,j,k<=' 



s+f (i,j,k) ^'*^‘'’^^^i+l,j-l,k+l 



(s) 



+ fg(i ^ 

1 £ i < B-1 1 1 k £ D-1 

i+j = B 1 £ j+k £ D-1 

2 09 



< cu 






s+f ( i , j , k) ^ ^ ^ 1 / k+1) P^^ 3 _ ^ j _ 3 _ ^ J^^ 3 _ 



(s) 






1 £ i £ B-1 1 £ k £ D-1 

j+k = D 1 £ i+j £ B-1 






s+f (i,j,k) ^'^■^^^^i+l,j-l,k+l^^^ ^ 



1 £ i £ B-1 1 £ k £ D-1 

i+j = B j+k = D 



(4.49) 
(Cont ’d) 



^0,j,0^®^ s+f (0,j,0)^^C^^'^ ^'^^^l,j-l,l^^^^ l£j£iran(B, 



D) 



"i,o,k(^) 



s+f (i,0,k)^^B^^ ^'^'^^^i-l,l,k 



(s) 



+ fr.(i,l,k-l)P. , , , (s)} 1 < i < B-1 1 < k < D-1 

L) 3. / X / K"” X — — — — 



P0,0,k^^) ^ s^fD(0'l'^-l^P0,l,k-l^^)^ ll^lD 



i,0,0 



(S) = |{f3(i-l,l,0)P^_^^^^Q(s)} l£i£B 



Equations (4.49) are in a form that is suitable for 
a recursive solution. Solving (4.49) recursively, we get: 
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s+f(B,0,D) 



^B-1,1,D-1^®^ s+f (B-1,1,D-1) ^ 



^B,9,D-1^®^ s+f (B,0,D-1) ^"B 



{f^(B l,l,D-l)Pg_^^j^^j^^ (s) } 



^B-2,2,D-2^^^ 



s+f (B-2,2,D-2)^^C^® 



^B-1,0,D^®^ 



s+f(B-l,0,D)^^D^® ^ 



^B-1,1,I>2^^^ s+f (B-l,l,D-2) ‘•"C 



{f^(B,0,I>l)Pg^Q^^^(s) 



+ fg(B 2,2,l>2)Pg_2^2,D-2^^^ ^ 



^B-3,3,D-3^®^ 



s+f (B-3,3,D-3) 2,2,D 2)Pg_2^2,D-2 ^ 



^B-2,1,D-1^^^ s+f (B-2,1,D-1)^^C^® ^'°'°^^B-1,0,D^^^ 



+ fD(B-2,2,r^2)Pg_2^2,D-2^^)> 



^B,0,D-2^®^ s+f (B,0,D-2) ‘•"B 



{f^(B-l,l,D-2)Pg_^^^^j^_2(s)} 



^B-2,2,D-3^^^ “ s+f (B-2,2,D-3)^^C^® ^^^B-l,l,D-2^^^ 



+ fg(B 3,3,D 2)Pg_3^3^Q_3(s) } 



(4.50) 
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^B-4,4,D-4^®^ 



s+f (B- 4 , 4 ,D- 4 )^^C^® 3/3, D 3 )Pg_ 3 ^ 3 ^ 3 , 3 (s) } 



^B-3,2,I>2^®^ s+f (B-3,2,D-2)^^C^® 3 /l/D-l)Pg_ 2 ^ 1 ^D_l(s) 



+ f 3 (B 3 , 3 ,D- 3 )Pg_ 2 ^ 3 ^ 3 _ 3 (s) } 



^B-2,0,D^®^ s+f (B-2,0,D) ^ * 



(4.50) 
(Cont ’d) 



Continuing in this manner we can solve for the Laplace 
transforms recursively starting from state (B,0,D). 

The state space, S, of the trivariate Markov process 
is a nonempty set of states. Define the set of edges E to 
be : 



E = { I (i, j ,k) , (n,m,£) ] : (i,j,k) and (n,m,5,) e S, 

and (n,m,Jl) is accessible from (i,j,k)} 

Since { B ( t) , C ( t ) , D ( t ) ; t ^ 0} is a multivariate pure death 
process, then E is a nonempty set of edges. The edges are 
ordered pairs [ ( i , j , k) , (n ,m , £) ] of states. The state (i,j,k) 
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is called the tail and the state (n,m,£) is called the head 
of the edge [ (i , j , k ) , (n ,m, £ ) ] . Let G = (S,E). Then G is a 

directed graph. For a definition and discussion of graphs 
see Aho, Hopcroft and Ullman (1974). Figure (4.2) illustrates 
the graph G. Define the depth of a state (i,j,k) in G to be 
the length of the path from state (B,0,D) to state (i,j,k), 
where the length of each edge is 1. 

The set of equations (4.50) shows that by knowing the 

t h 

Laplace transforms of the states at the n^ depth of the graph, 

s t 

then the Laplace transforms for the (n+1) depth can be 
calculated for any value of s. With this observation we can 
solve (4.49) by the following algorithm: 

t h 

1. Construct the graph of the process. For the n 
depth find the possible states and calculate its 
widtn, i.e., how many states are in the n'*^h depth. 
Continue until the width of the depth is zero. 

th. 

2. For the n depth, if width (n) ^ 0 then pick a state 
(say (i,j,k)). Then; 

2.1 Calculate the mean_of the corresponding sojourn 

time . ((f(i,j,k)) '^) 

2.2 Examine all states in the (n-1)®^ depth, to 
determine which states are accessible to state 
(i, j /k) . 

2.3 Calculate the corresponding transition rates 
from the state determined in (2.2) to (i,j,k). 

2.4 Calculate the Laplace transform for (i,j,k). 

Repeat for all states in the n^^ depth. If 
width (n) = 0, stop. 

Recall, in Chapter III we derived a one-to-one mapping 
between the multivariate Markov-process to a univariate Markov 
process. This mapping has been used for the above algorithm 
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Figure 4.2. A Graph Representation of the BCD Combat 
Process 



to be able to store and retrieve the states and their corres- 
ponding Laplace transforms. 

The solutions for equations (4.50), i.e., the Laplace 
transforms can be used to evaluate some measures of interest 
as follows. 

Suppose that the combat duration, Tg , is assumed to 
be a random variable distributed exponentially with mean 
. Let, 

Pi,j,k(Tg) = P{B(Tg) = i,C(Tg) = j,D(Tg) = klB(O) = B, 

C(0) = 0,D(0) = D,Tg } 

Following the argument provided for evaluating the 
readiness of the squadron at the time of attack under the par- 
tial surprise scenario, we can express the combat outcome in terms 
of a Laplace transform, as follows: 



E[P. . 

1.1 






/ P. . 

Q 1 , 1 / K 



CP. . 

1.1 



.k 



(C) 



(4.51) 



The probabilities P. . , (t) can be determined by 

1 . 1 / K 

✓s 

inverting the Laplace transforms P. . , (s); see Gaver (1966). 
A measure of interest is the probability of eventual 
survivors . 
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Let : 



= P{ i bombers eventually survive the combat} 



From (4.47) we get: 



'’1,0, 



fg(x 



(t) 



Integrating both sides, we obtain; 



t 



I 

0 



P ' 

i,0,0 



(t ) di 



fg(i-l,l,0) 



t 



/ 

0 



^i-1,1,0 



(t ) dx 



Therefore : 



^i,0,0^^^ 



fg(i-l,l,0) 



t 



I 

0 



^i-1,1,0 



( T ) dx 






p 

1 , 0,0 



(oo) 



= fg(i-l,l,0) 



cx> 



/ 

0 



^i-1,1,0 



( X ) dx 



Hence, in terms of Laplace transforms. 



tt^(B) 



fB(i-l'l'0)Pi_i, 1,0^0) 



(4.52) 
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It follows that: 



B(0) 

E [B (“) ] = I in . (B) 

i=l ^ 



B(0) 



i=l 






(4.53) 



Equations equivalent to (4.52) and (4.53) can be 
derived for the defenders by following similar arguments. 

3 . Markovian Combat Model for I Scenario 

Under the I scenario, the state of the process is 
given by {B(t); t ^ 0}. The transition probabilities 
the process {B(t) ; t ^ 0} of order dt are as follows: 



t t+dt 



Probability 



i ^ i-1 



fp (i) dt + o (dt) 
l-fp(i)dt + o(dt) 



(4.54) 



where in this particular case 



fj^(i) = min {i,D(0) } ; 



(4.55) 



Actually, the remaining results hold quite generally 
for arbitrary fj^(i). 



{B(t) ; 



Let D = D(0), and B = B(0). The stochastic process 
t ^ 0} defined by (4.54) is a pure death process with 
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state space {0,1,..., B}; see e.g.. Feller (1971), Chapter 
14. The parameters of the process are given by: 

/ for i = 0 , 1 , 2 , . . . , D-1 

fj^(i) = aj^min(i,D} = . (4.56) 

\ for i = D,...,B 



Let: 



P. .(t) = P{B(t) = j|B(0) = i} (4.57) 

1 ' J 

For simplicity of notation, we will suppress the 
initial condition for the moment, and write: 

P.(t) = P. .(t) 

j 1 / j 

The forward Chapman-Kolmogorov equations can be 
derived, as in the BCD case; i.e., the probability of being 
in state (j) at time t+dt is expressed by: 

Pj(t+dt) = (l-fj^(j)dt)Pj(t) + fp(j+l)dtPj^^(t) + o(dt) 

It follows that, 

P!(t) = -fj^(j)P.(t) + fj^(j + l)P.^^(t) 
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Therefore, the forward Chapman Kolmogorov equations are: 



P(!,(t) = f^{l)P^(t) 

Pj(t) = -fp(j)Pj(t) + fj^(j + l)Pj^^(t) 1 < j < B-1 (4.58) 

P^(t) = -f^,(B)Pg(t) 

with initial condition: 



Pj (0) 



. ( 



1 if j = B 



0 otherwise 



Let Pj (s) be the Laplace transform for P^ (t) . Then: 



Pj (s) 



/ e ®^P . (t)dt s > 0 
0 ^ 



Taking the Laplace transforms of (4.58), using inte- 
gration by parts and applying the initial condition, we obtain: 



Pj(s) = j ^(j)^ 3 {fD(j+l)Pj+i(s)> l<j<B(0)-l (4.59) 

?o<=) - |{fpi)q(s)) 



219 



Notice that (4.59) is already in a recursive form. Starting 
from state B(0) and proceeding recursively, we get: 



fj^(B)+s 

1 

^B-1^®^ fj^(B-l)+s^fjj(B)+s^ 

^B-2^^^ fj^(B-2)+s ^fj^(B-l)+s fj^(B)+s^ 

Continuing this way, we get; 



Pj (s) 



fD(j)+s 



B 

n 

n=j + l 



f (n) +s 



Therefore, the solution for (4.59) is as follows: 



Pb(s) 



fQ(B)+s 



Pj (s) 



B 



fpln) 



^d'3>+s n=j+l *D<">+= 



1 < j < B-1 



(4.60) 



Pn(s) = - n 

“ ^ n=l fD<")+= 



Note that the term f (n ) / ( f (n) +s ) refers to the Laplace 
transform of the time spent in state (n) . 
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a. Evaluation of Measures of Effectiveness: I 

Model 

A useful measure of effectiveness is to compute 

the probability of at least z bombers alive at time T (recall 

B 

Tg is assumed to be deterministic) in terms of B(0) and in 
particular, D(0) = D. The latter is influenced by logistics 
considerations. The probability of interest is: 

P{B(Tg > z|b(0) ,D(0)} 



Note that: 



B 

P{B(T^ > z|B( 0) = B,D(0) = D} = 7 P.(Tp) (4.61) 

^ , n t> 

] = Z + 1 



The probabilities Pj (t) can be determined by 
inverting the Laplace transforms P^ (s) , see Ross (19 83b) . 

Suppose Tg is assumed to be exponentially dis- 
tributed with mean ^ Then as in the case of BCD, we 

can express the probability of interest in terms of the Laplace 
transforms; i.e., it can be shown that: 



B 

E[P{B(T >z|B( 0) = B,D(0) = D/Tg}] = K I P^(?) (4.62) 

j=z+l ^ 
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If we continue using the assumption that bombers 
being engaged by defenders are considered to be ineffective, 
then a measure of interest is to compute the probability of 
at least one free bomber reaching the bomb release line. Hence 
the probability of interest is: P{B(T ) > D ( 0 ) I B ( 0 ) , D (0 ) } . 

To evaluate this probability we construct an equivalence 
relationship with the sojourn times of the process in every 
state. 

Let Xj , j = 1 , 2 , . . . , B ( 0 ) , be the sojourn times 

for {B(t); t ^ 0} in state j. Therefore, X^ , j = 1,...,B, 

are independent random variables, each with an exponential 

-fD(j)x 

distribution F (x) = 1 - e that has a rate Da for 

X • o 

D 

j = D,D=1,...,B, and a rate jUj^ for j = 1,2,...,D-1. 

The event {B(Tg) > D(0 )|b( 0) = B,D(0) = D} is 
equivalent to the event that the B(t) process at time Tg 
is at state j such that j e { D+1 , D+2 , . . . , B} . 

Let Sg be the waiting time until there are exactly 
D bombers alive. At this point each bomber is being attacked 
by a defender (according to the present model). Then 



B 

S = I X (4.63) 

j=D+l ^ 

Thus, the event {B(TJ > D(0 )Ib(0) = B,D(0) = D} 

Jd 

is equivalent to the event > T^|B(0) = B,D(0) = D} . But 

Sg is a sum of i.i.d. exponential random variables with rate 
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Therefore, the conditional distribution of given 
B(0) = B, and D(0) = D, is Gamma (B-D,Daj^) . 

Hence : 



P{B(Tg) > d|b( 0) = B,D(0) = D} = P{Sj^ > Tg|B(0) = B,D(0) = D} 



r B-D-1 

j ^ . t e dt 



(B-D-1) ! 



B 



Therefore, we obtain: 



P{B(Tg) > d|b(0) = B,D(0) = D} 



B-D (Da„t)^^ ^ -Da,.t 



n=l 



(4.64) 



Another measure of interest is to compute the 
expected number of bombers alive at time t, i.e., E[B(t)|B(0), 
D(0)]. To simplify the notation, we will temporarily suppress 
the initial condition, and write: 

E[B(t)] = E[B(t)lB(0) = B,D(0) = D] 

From the transition probabilities of B(t) of order dt given 
by (4.54), we get : 



B(t+dt) 



_ ( 



B(t) with probability 1-f (B ( t ) ) dt 



B(t)-1 with probability fj^(B(t))dt 
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E [B(t+dt) I B (t) ] 



B(t) - fp(B(t) )dt 



Taking expectation of both sides, we get, 



E[B(t+dt)] = E[B(t)] - E [fj^(B(t) ) Jdt 

Subtracting E[B(t)] from both sides, dividing by dt and 
letting dt tend to zero, gives: 

E'[B(t)] = -E[fj^(B(t) ) J 

B 

= - I 

3=0 “ ’ 

From (4.55), it follows that: 



D B 

E'lB(t)] = -{ I a^jP.(t) + I a^DP.(t)} (4.65) 

j=0 ^ J j=D+l ^ J 



B 

Adding and subtracting 'l right-hand side 

j=D+l ^ 

of (4.65), we obtain: 



B 

E'[B(t)] = -aj,E[B(t)] + I (j-D)P. (t) (4.66) 

“ ° j=D+l 3 
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From (4.60) 



we have. 



Pj (s) 



B 

n 






n=j'-l 



D+1 £ j < B-1 



(Da 



B-j 



Pj (s) 



D' 



(Daj^+s)® 



D+1 < j < B-1 



since 



then : 



f^(j) = DOj^ for D £ j £ B. 

__ 2^ /N /V 

Let L {P.(s)} denotes the inversion of P.(s), 



Pj (t) = L ^{Pj (s) } 



= L 



-l( 



B-j 



((DOj^+s)® 



Pj (t) 



B-j 

t e 



(B-j) ! 



D+1 < j < B 



Substituting into (4.78), we obtain: 



B 



E' [B(t) ] = 



(Da t)® ^ 

-a E[B(t)]+a I (j-p) ■ | - e 

j=D+l J ; . 



Adding a_^E[B(t)] to both sides of the above equation and 
multiplying by e , we obtain: 



. 67 ) 
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^{e ° E[B(t) ] } 



= a 



D . 



B -(D-l)o_t 

I (j-D) ° 



j=D+l 



(B-j) ! 



Integrating both sides, we obtain: 



a^-t B (j-D) (Da t -(I>l)a T 

e ^ E[B(t) ]-E[B(0)] = [ 57r^Ti / e ^ dr 

^ j=D+l • 0 






i=Dfl (D-1) 



B-j+1 



( -(D-l)a t B-j ((D-1) a t) 

ll-e ^ I ° 



k=0 



k! 



By transforming indices, we obtain: 



-a^t -a^t B-D 
E[B(t)] = Be ^ + e 



.^t B D j D B-D-j ( 



-(D-l)aj^t 



B-I>j ((D-Da^t)*^ )) 

J: 



B > D 



( 4 . 68 ) 



Note that if B < D, we obtain: 



E[B(t)] = Be 






When the combat process starts with B(0) = B _< D, 
then there are no free bombers . Every bomber will be 
engaged by a defender. 
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Define 



Y^(t) 



I 1 if the i defender is engaging a bomber 

I 0 otherwise 



Then, Y.(t), i = are i.i.d. Bernoulli random 

-at B 

variables with probability e . Therefore, B(t) = J 

is a binomial random variable parameter (B,e ). Hence 



Y^ (t) 



E[B(t) |b( 0) = B,D(0) = D] = Be ^ if B £ D (4.69) 

Note: The above result can also easily be found 

if the combat times of individual bombers vs. defenders are 
arbitrary but i.i.d., denoted Z: 

E[B(t)|B(0) = B,D(0) = D] = BP { Z > t} 

We summarize the above in the following result. 



RESULT (4.4) : 

The expected number of bombers alive at time t 
for the I model is given by: 
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j=l 



k! 



E[B(t) |B(0)=B,D(0)=D] = 



Be 



-aot 



' B-E^j ((I^DcLt)^ 

TTi !>> if B > D 



if B < D 



H. THE LARGE-DEVIATIONS APPROXIMATION FOR THE I MODEL 

The large deviations technique is based on the idea of 
displacing the distribution towards a value of interest, 
applying the central limit theorem to the displaced distri- 
bution, and re-displacing. The resulting approximation will 
better estimate the behavior of the distribution at the value 
of interest, particularly when it is in the tail (is of small 
probability). For an exposition and some useful theory, see 
Feller (1971) and Esscher (1932) ; for an application see 
Mazumdar and Gaver (1984). 

As noted earlier the combat process is, in the case of 
the I model, a pure-death process that starts initially from 
state B. The pure death process {B(t); t ^ 0} operates 
on the state space { 0 , 1 , 2 , . . . , B ( 0 ) } . Let , j = 0,1, ...,B, 
denote the sojourn times for {B(t); t ^ 0}, i.e., X^ measures 
the duration that the process spends in state j. Therefore, 

j = 0,1, ...,B, are independent random variables with an 
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exponential distribution F„ ( • ) that has a rate for 

X . D 

3 

j = D,D+1,...,B, and a rate ja^ for n = 0,1,..., D-1. 

The model is constructed to evaluate P{B(t) > z|b( 0) = B, 
D(0) = D}. The event {B(t) > z|B( 0) = B,D(0) = D} is equiva- 
lent to the event that the process at time t is at state j 
such that j e { z+1 , z+2 , . . . , B} . Let S be the waiting time 
to get exactly z bombers surviving. Then we have: 



B 

S = y X. 0<z<B (4.70) 

^ j=z+l ^ 

Thus the event {B(t) > z|B( 0) = B,D(0) = D} is equivalent 
to the event {S^ > t|B(0) = B,D(0) = D} . It follows that: 

P{B(t) > z B(0) = B,D(0) = D} = P{S^ > tlB(O) = B,D(0) = D} 

B 

= P{ X. > t|B(0) = B,D(0) = D} 

j=z+l ^ 

Note that the case B £ D is a special case of a more 
general case where B > D. Therefore, in what is to follow, 
we will assume that B > D. 

Let: 



oo 

(s) = / {dt} 

j -00 j 



(4.71) 
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assumed to exist for real s > 0, Sq<s <0. Since the random 

variables Xj for j = D,D+1,...,B are i.i.d. random variables 

then they have the same moment generating function. Let 

4) (s) be such a function. 

X 

/s 

Let Fj, (s) be the moment generating function of S . To 

Z /% /s 

simplify the notation let F(x) = F (x) and F(s) = F (s) . 

z z 

We will also suppress the initial condition. Then 



r 



sS 

F(s) = E[e ] = E[e 



B 

I 

j=z+l ^ 



Since the random variables Xj are independent, we get: 



F (s) 



j=z+l j 



(4.72) 



Let V be the probability distribution associated with 

2 

F(-), with mean )i and variance a where: 



V{dx} = e^^F{dx} ^ s > 0 (4.73) 

F (s) 



Let V(^) be the moment generating function of V. Then: 



V(^) 



00 

/ e^^V{dx} 

— oo 



oo 



/ 



— oo 



F(S) 
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Therefore : 



V(5) = C > 0, s > 0 (4.74) 

F(s) 

Substituting equation (4.72) into equation (4.74), we 

get : 



V(5) 

Let K(C) = £n V(C) be the corresponding cumulant generating 
function. Then, 



= ( 



<J)j^(?+s) 

(p^is) 



B-D 



D-1 

n 

j=z+l 



J 



? > 0 
s > 0 



(4.75) 



K(?) = (B-D) (£n (})j^(C+s) - £n (J)j^(s)) 



D-1 

+ I (in (p (C+s) 
j=z+l 



£n (s) ) 

j 



(4.76) 



Differentiating equation (4.76) with respect to and 
evaluating the resulting function at ^ = 0 , we get the 
following expression for the mean y(s). 



y (s ) 



(B-D)(j)^(s) 



D-1 



I 

j = z+l 



(s) 

i 

(s) 

j 



(4.77) 
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Differentiating equation (4.76) twice with respect to 
5, and evaluating at ^ = 0 , we get the following expression 
for the variance: 



o (s) = 



(B-D){(j) (s)(f);;(s)-((j)' (s))^} i>i 'i'x. (s)) 

^ ^ A , V _2 3 j 



%(S))‘ 



+ I 

j=z+l 



(s))‘ 



(4.78) 



where : 



and 



<P^(s) 



Da 



D 



DOd-s 



S > 0 



(4.79) 






ja 



D 



Dao-s 



s > 0, j = 0,1,...,D-1 



(4.80) 



Da 



<l>^(s) = 



D 



(Da^^-s; 



s > 0 



(4.81) 



<{)x.(s) 






( jotp-s) 



s > 0, j = 0,1,...,D-1 (4.82) 



2 Da 



<^;^(s) = 



D 



(Da^^-s : 



s > 0 



(4.83) 



<^;^,(s) 



2 ja 



D 



(jop-s: 



s > 0, j = 0,1,...,D-1 (4.84) 



Note that the mean and variance of the associated dis- 
tribution, equations (4.77) and (4.78), respectively, are 



232 



functions of s. Therefore, there is a family of associated 



distributions for F (•). Let y(s) = t (i.e., center the 

z 

associated distribution at the point of interest) , and solve 
for s. Let s be the value of s such that y(s) = t. Thus, 
an associated distribution V has been determined. Therefore, 
equation (4.73) becomes: 



V{dx} 



e^^F{dx } 
F(s) 



s > 0 



(4.85) 



with : 



mean = y ( s ) = t 



and 



variance = o (s) 



Thus : 



^ ~ — Q y 

F{dx} = F(s)e ^V{dx} 



(4.86) 



and 

oo 

P{s, > t} = / F{dx} 

^ t 



Substituting, we get: 
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(4.87) 



P{S^ > t} = F(s) / e ^^v(dx} 



Invoke a normal approximation to V; this is justified 
if the sum belongs to the domain of attraction of the normal 
distribution according to the central limit theorem. Cer- 
tainly the initial B-D components are i.i.d. and have a 
second moment by assiomption, and hence the CLT does apply 
to their sum. Provided z is not too small (e.g., if 
z = kB(0) , k fixed) , then the remaining terms are also 
well behaved, and the normal approximation should be adequate. 

Therefore, it follows that 

- (x-y (s) ) ^ 

~ CO "" 2 ~ 

P{s > t} - P (S > t) E F(s) — -/ e"®^e 

^ ^ ^ v^y(s) o(s) 



By standard substitution, w 



x-y (s) 
a(s) ' 



we obtain: 



2 

^ w 

P,^{S > t} = F(s) r ^-s(u(s)^o(s))J 2 

^ ^ mo 



Multiplying the right-hand side by e^ ^ ^ , to 

complete the square, we get: 



= F(s)e 



-sy (s) 



+2S 



2 2 
o (s) 



- j(w+SO (s) 



P.„{S > t} 



dw 



Let X = w + sa(s) . From the above equation, we obtain: 



> t} - F(s)e 



~sy(s)+ 2 S o (s) 



/2tt so (s) 



/ 



- x^/2 , 
e ' dx 



(4.88: 



Using equations (4.72) and (4.79) to (4.82), we obtain; 



F(s) = 



Dqd ^ ! D-1 



Dao-§ 



j=z+l ® 



Since y(s) = t, equation (4.88) becomes: 



> t} 



/ \®"°/ ^an \ ~st+^^a^(s) 

I n e ^ (l-4>(sa(s))) 



(4.89) 



where : 



i|)(x) is the standard normal probability distribution 
function, and 



(s ) 



B-D 



D-1 



+ I 



(Doj^-s) j = z + l (jap,-s) 



2 ' 



D 



and s is the appropriate solution of: 



B-D 

Dud-S 



+ 



D-1 



j=z+l 



= t 



(4.90) 
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To solve for s, we note that s > 0 since it is the trans- 
form variable for the moment generating function. We also 

note that in order to have P{S > t} > 0, we must have 

z — 

3 % 

T- > 0 for every j = z+l,...,D-l. Hence, s < (z+l)a_. 

^ D 

Therefore we obtain the following condition on s: 



0 < s < (z+l)aj^ 



(4.91) 



Define : 



t* 



B-D 

Da^ 



D-1 

+ I 

j = z + l 



lOi 



D 



Hence, if t > t*, then s > 0. We now need to determine if 

for all values of t > t* there will always exist a 0 < s < (z+l)ap 

such that equation (4.90) is true. 

Def ine : 



f (s) 



B-D 

Da^-s 



D-1 



j = z + l 




t 



The function f(s) is a piece-wise continuous (differen- 
tiable) function with points of discontinuity s = ja , 

D 

j = z+l,...,D. Differentiating f(s) over the ranges of 
continuity (differentiability), we get: 
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f ' (s) 



B-D 



1 



D-1 



2 + I 

(Daj^-s) j=z+l 



for 0 < s < (z+l)aj^ 



and for jaj^ < s < (n+Da^; j = z+2,...,D. 

From the model assumption we have B ^ D. Therefore 

f'(s)>0 V 0<s< (z+l)aj^; < s < (j+l)aj^ 

Hence, the function f(s) is a piecewise continuous func- 
tion, and each piece is a monotbnically nondecreasing function 
over its corresponding range. 

Note that f(0) < 0 for t > t*, and f((z+l)aj^) = °° for 
any t. Thus, by imposing the condition t > t*, there will 
always exist 0 < s < (z+l)aj^ such that f(s) = 0. The bisec- 
tion method (Gerald, 1984), was implemented to determine s 
numerically . 

Hence, the Large-Deviation approximation for the invul- 
nerable combat model becomes : 



P{B(t) > z|B(0) = B,D(0) = D} 




X (1 - 0(sa(s) ) ) 



where : 
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t > 



B-D 



1 



B > D 



Da, 



D-1 

+ I 



j = z + l 



(s) 



B-D 



(Da^-s) 



D-1 



I 

j = z+l 




2 



and 



0 < s < (z+Da^ 



such that: 



B-D 

Dtto-i 



+ 



D-1 



I 

j =z+l 




t 



In Appendix A we derive a general equation for the 
large deviations approximation for a fixed and a randomized 
sum of i.i.d. random variables, together with some applications 
to other logistics problems. 

I. SIMULATION OF BCD MARKOVIAN MODEL 

In order to check the multivariate diffusion approxi- 
mations for the BCD model, a simulation was carried out by 
using Monte-Carlo methods to generate a realization of the 
air-to-air combat process, which is modelled as a trivariate- 
continuous-time discrete-state Markov process. Combat data 
were then generated to compute combat statistics. 
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The Monte-Carlo simulation was constructed based on the 



following: 

a. The time spent by the process at state (i,j,k) is 
exponentially distributed with rate f(i,j,k). If 
desired, the exponential distribution can be replaced 
by an arbitrary distribution function to obtain a 
semi-Markov model. 

Let Xj^ be the sojourn time for state (i,j,k). 

Then: ' ' 



P{X 



i, j 



< t} 




-f (i, j ,k) t 

^ r 



t > 0 



, t < 0 



( 4 . 92 ) 



b. The transition probabilities for the embedded Markov 
chain are as follows: 



Present 

(i,j,k) 



Next 

(i+1, j-l,k) 
(i-1, j+l,k-l) 
(i, j-l,k+l) 



Probability 





j rk) 


f (i, j 


,k) 




j /k) 


f (i, j 


,k) 


f D ^ ^ ' 


j ,k) 


f (i/ j 


,k) 



( 4 . 93 ) 



The conditions in (a) and (b) are used, together with a 
uniform random number generator that produces independent 
samples of a random variable that is uniformly distributed 
over the interal (0,1), so as to generate a realization of 
the combat process. This is done by generating two independent 
samples of a unit uniform variate, denoted by and U^- 
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U-| is used to produce a realization of the time X. • ' 

time spent in state (i,j,k) , by applying the inverse trans- 
form method, as follows: 



P{X. . , < X. . , } 

1,] ,k - 1,3 ,k 



1 _ e“^ (i/ j /k)x 



U 



then 



-f(i,j,k)x. , 
e 



1 - U 



U 



1 



Therefore , 



-f (i, j ,k)x. . , = Jin U 

1 , J , K 

Thus, we obtain, as is well-known, 

- £n 

^i,j,k " f (i, j ,k) 



(4.94) 



The number U 2 is used to determine which state the process 

will enter next. After spending x. . , units of time in 

1 ^ D ^ 

state (i,j,k), the process will next transit to: 



(i+l,j-l,k) 



if 



0 < U 2 



fgU^jrk) 

- f (i,j,k) 



(i-l,j+l,k-l) if 



fg(i,j,k) fg(i,j,k) + f^(i,j,k) 

f (i, j ,k) ^ ^2 - f (i/ j ,k) 



(4.95) 



(i,j-l,k+l) 



otherwise 



We collect statistics for the process by discretizing 
the time domain. Let At be the length of the time increments 
and T be the length of time for the simulation of the process 
T could be the time for bombers to be in region from detec- 
tion to hand-over line. Define N to be the number of incre- 
ments in T. Then; 



Construct the following: 

BB,BS to be arrays of size (N+1) whose entries are 



M 

BB(n) = y B^(nAt); BS(n) 

^ T lU 




M 



m=l 



CC/CS to be arrays of size (N+1) whose entries are 



M 

CC(n) = I C^(nAt); CS(n) 



m=l 



I C^(nAt) 
^ T m 



DD/DS to be arrays of size (N+1) whose entries are 



M 

DD(n) = I D^(nAt), DS(n) 




M 



m=l 



where : 
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(Bj^(nAt) ,C^(nAt) ,Dj^{nAt) ) 
t h 

is a (the m ) realization of the state of the process at 

•f" Vi 

time nAt for the replication, and M is the total number 

of replications. 

_ 2 

Let B(t) and S (B(t)) be the sample average and variance, 
respectively, for B (t) . Then: 

M 

[ B^(nAt) 

B(nAt) = n = 0,1,. ..,N (4.96) 



and 



M (B (nAt)-B (nAt) ) ^ 

S (B(nAt)) = I — n = 0,1,. ..,N (4.97) 

m=l 

It can be shown that the above are unbiased estimators 
for the process mean and variance (Larson, 1983). 

Equations similar to (4.96) and (4.97) can be constructed 
for C(t), and D(t). 

J. NUMERICAL ILLUSTRATION FOR VARIOUS COMBAT MODELS 

This section presents some numerical illustrations for 
the various combat models presented above. The illustra- 
tions will be conducted by comparing the diffusion approxima- 
tions with the simulation estimations or the actual parameters 
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when possible. Therefore, for the BCD combat model we 
compare the diffusion approximations to the simulation 
estimations, while for the I combat models we compare the 
diffusion and the large deviations approximations to the 
actual values. 

1. An Illustration for the BCD Combat Model 



The following basic data were used as an example 
for model illustration: 

- A threat of B(0) = 12 bombers attacking an area of 
responsibility of an interceptor squadron that is 
assigned exactly a = 40 aircraft. Therefore, at the 
time of attack, the interceptor squadron will have 
D(0) aircraft ready to engage in combat where 

0 < D(0) < a. 

- Each interceptor aircraft (and bomber) is assumed to 

take an exponential amount of time, to kill its 
opponent with mean = (.008)“! seconds (and 

(oig)“l = (.004)~1 seconds) respectively. 

- The command and control system is assumed to take 
an exponential amount of time, with mean (6)”^ = 
(.006)“! seconds, to detect and engage a free bomber. 

FORTRAN programs were written for: 

1. Computing the approximate mean and variance for B(t) 
using the diffusion approximation. 

2. Simulating the discrete-state Markovian combat process 
to compute the mean, and variance for B(t) . The 
number of replications M = 10,000. 

For illustration purposes the following values for 
D(0) were considered: 



D(0) = 6, 12, 16, 20, 30, and 40 . 



Figure (4.3) shows plots of the simulation mean, 
and the deterministic mean resulting from the diffusion model 
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ttB(0] 



0 ( 0 ) - « 



0(0) - t2 





0(0) - 16 0(0) - JO 





0(0) - » 0(0) - 40 





Figure 4.3. 



Plots of Deterministic 
Stochastic Kean of B(t) 



Mean Versus the 
: BCD Scenario 
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for the above cases. It is clear from the plot that the 
diffusion approximation produces a good approximation for 
the mean of the process. 

Figure (4.4) shows a comparison of the variance func- 
tion resulting from the diffusion model with the variance 
function resulting from simulating the Markovian combat proc- 
ess, for the above different values of D(0). The figure 
shows that the diffusion approximation provides a good 
approximation to the variance as D(0) increases. Since we 
are assuming an increase of B(0) + D(0) where B(0) and 

D(0) “ simultaneously and at a fixed proportion. We 

therefore consider the following 3 cases (k = B(0)/D(0) = 0.6). 



B(0) D(0) 



Case 


1: 


12 


20 


Case 


2: 


15 


25 


Case 


3: 


18 


30 



Figure (4.5) shows a plot of the resulting vari- 
ance functions of B(t) for the above cases as determined 
by the simulation model and the diffusion approximation. 
The figure shows that the variance approximation result- 
ing from the diffusion model greatly improves as B(0) and 
D(0) simultaneously and at a fixed proportion. Note 

that the diffusion variance is systematically larger than 
the simulation variance, but the discrepancy is reduced as 
time advances. Since it is probably the relatively long 
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VAate<0) VA#?fS(!)) VA«(B(0J 



0 ( 0 ) - 6 



0 ( 0 ) - 12 




£>(0) • 16 0(0) a 20 




Figure 4.4. Plots of the Variance Approximation Resulting 

from Diffusion Versus Variance from Simulation, 
for B(t): BCD Scenario 
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Figure 4.5. A coraparison of the Diffusion and Simulation Variance 
of B(t) as Both B(0) and D(0) ~ simultaneously 

snH in a ProDortion of .6: BCD Scenario 



times (of flight of the bombers towards their objective) 
that is of interest, the discrepancy may not be serious, 
but in any case the direction of the difference is conser- 
vative: The diffusion model will predict greater leakage 

of bombers than does the (presumed) more exact simulation. 
The diffusion computation is far more computationally 
economical- Its adoption actually permits many more rapid 
calculations than would use of simulation. 

2. An Illustration for the Invulnerable Combat Model 



The following basic data were used as an example 
for model illustration: 

A threat of B(0) = 20 bombers attacking an area of 
responsibility of an interceptor squadron. 

The squadron has exactly D(0) = 13 aircraft operational 
and ready to engage. 

Each interceptor aircraft is assumed to take an 
exponential amount of time to kill a bomber with mean 
(a|^)“^ = 20 minutes. 

An interceptor aircraft is assumed to be invulnerable, 
and is controlled by a perfect command and control 
system. Therefore the time taken for a free defender 
to start engaging a free bomber is instantaneous, i.e., 
equal to zero. 

The intelligence has reported that the enemy tactical 
doctrine dictates that the raid to be cancelled if 
there are z = 2 bombers or less alive. Hence, we are 
interested in evaluting P{B(t) > 2 |b(0) = 20,D(0) = 13} 

FORTRAN programs were written for: 

1. Computing the stochastic mean, stochastic variance 
and probabilities using the Markov-process formulation 

2. Computing the approximate mean, and variance using 
the diffusion approximation, and then applying the 
central limit theorem to compute the required 
probability . 
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3. Computing the approximate probability using the large- 
deviations approximations. 

Figure (4.6) shows a plot for the stochastic mean 
compared to the deterministic mean. We find that the 
deterministic mean yields a good approximation for the sto- 
chastic mean. To further investigate that, a plot of the 
stochastic mean versus the deterministic mean, and a plot 
of the difference between the stochastic mean and the deter- 
ministic mean versus time, are shown in Figure (4.7). It is 
obvious from the figure that the two means form a 45° line 
when plotted against each other. Figure (4.7) shows that the 
bias between the 2 means tends to zero as t -> «>. The bias 
is defined to be the difference between the stochastic mean 
and the deterministic mean. 

Bias = Stochastic mean - Deterministic mean 

Figure (4.7) also shows that the bias is always 
positive and tends to increase from zero at t = 0 to a 
maximum bias of .167, and then starts to decrease to zero as 
t ->■ 00 . This shows that the deterministic mean under- 
estimates the stochastic mean for the initial stages of 
combat . 

Figure (4.8) shows a plot for the exact variance 
compared to the variance resulting from the diffusion approxi- 
mation. We find that the variance obtained by diffusion gives 
a good approximation to the exact variance. Plots of the 
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Figure 4 . 6 . Stochastic Expectation Versus Deterministic Expectation; 
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Figure 4.8. Stochastic Variance Versus Variance by Diffusion 



stochastic variance versus the diffusion variance, and 
of the difference between both variances versus time, 
are shown in Figure (4.9). It is obvious from the figure 
that there exists some bias in the variance, and such bias 
tends to disappear as t In this case, the bias is 

defined to be the difference between the stochastic variance 
and the diffusion variance. 

Bias = Stochastic Variance - Variance by Diffusion 

Since there exists bias in both the mean and 
variance approximations, we expect to have some difference 
between the actual probabilities for the Markov process 
and the probabilities resulting from applying the normal 
approximation . 

Figure (4.10) shows a comparison between the actual 
values for P{B(t) > 2 [b( 0),D(0)} as a result of applying the. 
Markov-process model, and the normal approximation values 
without continuity correction using the diffusion approxima- 
tion. Figure (4.11) shows the same comparison as Figure 
(4.10) but after applying the continuity correction factor 
to the diffusion approximation. We find that the continuity 
correction factor has improved the diffusion approximation 
results . 

Figure (4.12) shows a comparison between the actual 
values of p{B(t) > 2 [b( 0),D(0)} and the large deviations 
approximation at large values of t. There is no continuity 
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Figure 4.9. Bias of the Variance by Diffusion Approximation: I Scenario 
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Figure 4.10. Comparison of Actual and Diffusion Probabilities without 
Continuity Correction: I Scenario 
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Figure 4.11. Comparison of Actual and Diffusion Probabilities with 
Continuity Correction Factor: I Scenario 



PROBABILITY BY LARGE DEVIATIONS 
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Figure 4.12. Comparison of Actual and Large Deviation 
Probabilities,' for I Scenario 



correction for the large deviations, since the large deviation 
equation has been derived for a sum of exponential random 
variables. Figure (4.13) shows a comparison of the actual 
probability and the diffusion approximation for large values 
of t. Comparing Figures (4.12) and (4.13), we find that, 
for large values of t, the large deviations better approximate 
the actual probability than the diffusion approximation. 

Figure (4.14) shows a plot of the diffusion approximation 
versus the actual probability for large values of t. We 
find that the resulting curve doesn't form a 45° straight 
line. Figure (4.14) also shows a plot of the relative error 
over time, where 



relative error 



[Actual - Diffusion! 
Actual 



We find that the error tends to increase steadily until it 
hits a 100% error, a 100% error means that the diffusion 
has resulted in P{B(t) > 2 |b( 0),D(0)} = 0, while the actual 
probability is not yet equal to zero. 

Figure (4.15) shows a plot of the large deviations 
approximation versus the actual probability. We find that 
the resulting plot forms approximately a 45° straight line, 
which suggests that the large deviations yield a good approxi- 
mation to the actual probability. Figure (4.15) also shows 
a plot of the relative error over time, where the relative 
error, in this case, is defined as: 
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Figure 4 . 13 . Comparison of Actual and Diffusion Approximation 
for Large Values of t 







4 I , I i I, I I. ,,,1 

on 9 0 f'o ro 

JOLQ 




1 

5 



260 



Figure 4.14. Error Analysis for the Diffusion Approximation 
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Figure 4.15. Error Analysis for the Large Deviations Approximation 



Relative Error 



[Actual - Large Deviations 
Actual 



We find that the error tends to increase initially 
but drops to zero for very large values of t. This suggests 
that the large deviations tend to give a better approximation 
for large values of t (i.e., for values that are in the 
far tail ) . 
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V. COMBAT-LOGISTICS MODELS 



A. INTRODUCTION 

One of the major problems an air force faces is the 
determination of its budget allocation when a new weapon 
system is to be phased in. In this chapter, the term "weapon 
system" means that air force system which consists of the 
following : 

• Aircraft. 

Spare parts. 

• Repair facilities, including personnel. 

• Early warning system. 

Other components, such as the intelligence system, and 

3 

the communication, command and control (C ) system can be 
considered to be part of the general weapon system defined 
above. For example, as seen in the operational logistics 
models constructed in Chapter II, the effect of the intelli- 
gence system is considered under the total and partial surprise 
scenarios. The C^ system effect is introduced very economically 
in the combat models under the BCD scenario, developed in 
Chapter IV, which is represented by the time spent to detect 
and engage an enemy bomber. The early warning system influ- 
ences the duration of the combat . The sooner the attack is 
detected, the sooner the defenders can meet and engage it 
before it reaches the handover or bomb release line. 
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The outcome of combat depends upon the number of defenders 
ready to engage at the time of attack, D(0) . For planning 
purposes, D(0) is a random variabe; its distribution has 
been determined in Chapters II and III by use of the logis- 
tics model. 

The effectiveness of a weapon system, WS , must be evalu- 
ated by a model that determines the readiness of WS at the 
time of attack, and then computes the MOE for the squadron. 

Hence, we need a model that is capable of integrating a 
logistics model with a combat model. Such a model is referred 
to as a Combat-Logistics model . 

In formulating combat- logistics models, the type of air- 
craft is assumed to be known to the analyst. In reality the 
analyst may wish to assess the effectiveness of different 
aircraft types- Mathematical optimization techniques may 
finally be applied to the combat-logistics model to define 
the optimal weapon system. 

B. OBJECTIVES 

The main objective of this chapter is to determine an 
optimal weapon system for an interceptor squadron that meets 
specified mission needs. The determination takes into account 
budget, combat, and logistics constraints. 

To determine an optimal weapon system, means first to 
identify the various feasible weapon systems that are avail- 
able for the decision maker, considering "real-life" constraints, 
and then to select the weapon system that optimizes the 
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measure of effectiveness of the interceptor squadron. In 
reality it may be best to present the decision maker with 
a selection among a few systems (a short menu) along with 
some uncertainty assessments as to cost and performance. 

C. SCOPE 

An air-interceptor squadron is selected to represent 
the situation under study. The squadron is considered to 
consist entirely of the same type of interceptor (or fighter) 
aircraft. The decision maker has a budget of $K for procur- 
ing the weapon system, and an annual budget of to be 

allocated for maintenance facilities (repairmen or crews, 
and equipment) . 

This study concentrates on finding the optimal way of 
distributing (allocating) the initial budget and the annual 
budget among the different components of the weapon system. 

Here the term "optimal" refers generally to the minimization 
of the probability of enemy bomber's penetration. The proba- 
bility of penetration has been analyzed in the previous 
chapter . 

D. THE MODEL'S BASIC CONCEPT 

1 . General 

The CL model assumes a small or middle-sized air force, 
represented by a squadron, defending a specific area of 
responsibility against a known enemy. However, the mathemati- 
cal modelling is more general and can be applied to many 
different situations of varying force size and composition. 
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2 . SpecjLfic Assumptions 



The following specific assumptions can be made: 

(i) The threat can be assessed far into the future. 

The number of enemy bombers attacking, together 
with their capabilities, can be predicted. 

(ii) There is no attrition of aircraft and/or modules 
during non-combat periods. 

(iii) No modules leave or enter the logistics system. 

(iv) There is only one level of repair (i.e., no depot 
repair) . 

(v) Immediate replacement of flight-line level. 

(vi) Full instantantous cannibalization. 

(vii) There is no recruiting or attrition of repairmen 
(or crews) during the non-combat periods. 

(viii) There is no support from any of the neighboring 
country's air force during the combat periods. 

E . APPROACH 

To achieve the above objectives, the combat-logistics 
process of the squadron has to be analyzed. The combat- 
logistics process represents the combat, non-combat activities 
of the squadron. The effect of the budget allocation supplies 
the restrictions for determining the optimal weapon system. 
When a weapon system is procured, it will operate under a 
peacetime environment (non-combat periods) , where it should 
be managed and maintained so that it is found in maximum 
readiness when called upon for combat. The weapon system 
then performs its prime objective (conducts combat) , so as 
to achieve certain combat objectives, as measured by a 
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suitable MOE. Therefore, when comparing weapon systems, we 
need to evaluate the weapon system under both peace and 
wartime (combat and non-combat) environments. 

WS is first evaluated during non-combat periods by the 
operational logistics models discussed in Chapters II and 
III. The readiness (availability) of aircraft is then deter- 
mined as an initial condition for the warning model. If a 
total surprise scenario is considered then the distribution 
of aircraft readiness, resulting from considering the limiting 
distribution of the operational logistics model, is provided 
as an initial condition for the combat model. If a partial 
surprise scenario is considered, then the limiting distribu- 
tion of the operational logistics model is considered to be 
the initial condition for the warning model, constructed 
in Chapter II. The warning model provides the distribution 
of aircraft readiness at time of attack. This is used as 
an input to the combat model, where MOE ' s are then evaluated. 

A schematic for the above approach is shown in Figure (5.1). 

The combat-logistics process can be formulated as a 
mathematical programming problem. The constraints for the 
mathematical program are divided into two categories. 

1 . Budget Constraints 

The budget constraints are subdivided into the 
following two categories: 

(a) Fixed budget constraint: This represents the 

total budget allocated for procuring WS . 
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Figure 5.1. A Schematic for a Combat-Logistics Model 
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(b) Annual budget constraint: This represents the annual 

budget allocated for the squadron to operate and 
maintain WS . 

2 . Operational Constraints 

These represent the necessary levels for the various 
components of WS, so that the squadron can conduct its mission 
during both combat and non-combat periods. Note that the 
budget constraints may be incompatible with the operational 
constraints (requirements). 

F. PROBLEM FORMULATION 

We now consider a simplified illustrative representation 
of the problem confronting a decision maker. Consider an 
aircraft squadron that is assigned a budget of $K to procure 
WS. WS is to consist of: 

1. A number, a, of aircraft. 

2. Mj^ and M 2 repairable modules of Type 1 and Type 2, 
respectively . 

3. Rq and R 2 repairmen to be assigned to Shop 1 and 
Shop 2, respectively. 

4. An early warning system. 

Suppose the squadron is allocated annually as a 

maintenance budget (or annual salaries for repairmen (plus 
the cost of necessary equipment) . 

The squadron is to defend the area against a prototypi- 
cal threat of B(0) enemy bombers, attacking simultaneously 
a number of national and/or military targets. The squadron 
is assigned the responsibility of minimizing the probability 
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of the enemy bombers' penetration to or beyond their bomb 
release line (a hand-over line) . Recall the following com- 
bat model. Each enemy bomber is assumed, when engaged by 
a defender, to take an exponential amount of time, with 
mean a to kill a defender (if unopposed). Each defender 
is assumed to take an exponential amount of time, with mean 
0 to detect and engage a free bomber, and an exponential 
amount of time, with mean to kill a bomber (if unopposed) 

once engagement starts; the combat is thus modelled as a 
competing risk problem. It is assximed that only one free 
defender can engage a free bomber, and that the engagement 
will be f ight-to- the-f inish . 

Let X denote the overall Markovian failure rate of an 
individual aircraft, and let p^^ denote the conditional proba- 
bility that a failure requires just Type 1 (e.g., engines) 
repair, P 2 the conditional probability that the failure is 
of Type 2 (e.g., avionics) and pj ^2 the conditional probability 

that both Type-1 and Type -2 failures occur. Thus, p^^ + P 2 + Pj ^2 
= 1, and the sequence of successive failure types is one of 
independently and identically distributed random variables. 
Finally, it is assumed that repair is Markovian (or exponen- 
tial) , where only one repairman can work on a failed module, 
and |j^ denotes the rate at which an individual repair of 
Type i, i = 1,2, is completed at Shop i. Let be the 
number of repairmen assigned to Shop i, i = 1,2. 
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Recall that: 



X^(t) , i = 1,2, denotes the number of modules of Type i, 
i = 1,2, that are in or require repair at time t. 

B(t) denotes the number of free bombers at time t. 

C(t) denotes the number of bombers (hence defenders) in 

engagement at time t. 

D(t) denotes the number of free defenders at time t. 

As shown in previous chapters, the stochastic process 
{ ( t) , X 2 ( t ) ; t ^ 0} is a bivariate birth and death process; 
and the stochastic process {B (t) ,C (t) ,D (t) ; t ^ 0} is a tri- 
variate pure death process, defined by (2.16) and (4.45), 
respectively . 

It was shown in Chapter IV that the process 
{B (t) ,C (t) ,D (t) ; t ^ 0} can be approximated by the trivariate 
diffusion process { B ( t ) , C (t ) , D (t ) ; t ^ 0}; where B(t), C(t), 
and D(t) is the continuous approximation for B(t), C(t), and 
D(t), respectively. 

G. MODEL'S STRUCTURE 

1 . The Objective Function 

The objective of the squadron is to minimize the 
probability of penetration of enemy bombers. The probability 
of more than z free bombers reaching their bomb release line 
is given by P{B(t) > z|b( 0)}; this can be obtained by blend- 
ing the combat model with the logistics model. From the 
law of total probability, we obtain: 
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P{B(t) > z I B(0) } 



= I P{B(t) > z,D(0) = j |B(0) } 
j=0 



It follows that. 



a 

P{B(t) > z|b(0)} = I p{B(t) > z|B( 0),D(0) = j}P{D(0) = j} (5.1) 

j=0 

Let (J (B (0) ,D (0) ,t) and (B (0) ,D (0) ,t) be the conditional 
mean and variance of the marginal process {B(t); t ^ 0}, 
given the initial force levels. From Results (4.2), and 
(4.3), we find that: 

B(t) ~ N(y (B(0) ,D(0) ,t) ;a^ (B(0) ,D(0) ,t) ) 

It follows that P{B(t) > z|B( 0) = B} can be conveniently 
calculated as follows: 



P{B(t) > z|B(0) = B} - I P{B(t) > z|B(0) = B,D(0) = j}P{D(0) = j} 

j=0 



a 

I 

j=0 



{1 - H 



z- y(B,j,t) 
a(B,j,t) 



•}}P{D(0) = j} 



(5.2) 



Thus , 
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P{B(t) > z|B(0) = B} 



a 



1- I 

j =0 






z-u(B,j,t) 
a (B, j ,t) 



•}P{D(0) = 



j} 



where : 



$ (x) 



/ 



— oo 



1 - u ^/2 

e ^ du 

/ 2 ^ 



Hence, the objective function can be approximated by. 



a 

min 1 - J 

WS L j =0 



. z-y(B,j,t) 
^ o(B,j,t) 



-}P{D(0) = j} 



/ 



or equivalently by: 



max 

WS 



I 

Lj=o 



z-y (B, j,t) 
o(B, j,t) 



■}P{D(0) = 



j} 



(5.3) 



where min [ ] refers to the act of minimizing (maximizing) 

WS 

the quantity [ ], subject to budget constraints. 

To evaluate the objective function, we need, for every 
j , to: 

(a) evaluate the term — 7 ^=; — ( •) using one of the 

o (B, 3 , t) 

diffusion combat models constructed in Chapter IV. 
Alternative combat representation can also be 
utilized as required, but the diffusion model renders 
computer calculations economical . 

(b) evaluate the term P{D(0) = j} using one of the 
operational logistics models constructed in Chapters 
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II and III for a range of logistics assets (spare 
parts, repair facilities) that is within budget 
constraints . 

(c) select the optimal combination from the results of 
(b) . 

2 . Budget Constraints 

a. Fixed Budget Constraint 

A major constraint when a weapon system is to 
be procured is the amount of available (or planned) budget. 

The budget is thought of, in this study, as a fixed budget 
that is available to purchase the hardware components of the 
weapon system, which are: 
aircraft, 

modules of Type i, i = 1,2,...,I 
- early warning system 
where : 

I = number of different types of modules 

Hence, the budget must be equal to or exceed 
the summation of the products of the above components of 
WS times their individual cost coefficients, assuming that 
linear costs are appropriate; otherwise a suitable non- 
linear cost is required. Thus: 

I N 

+ y c.M. + y d E < K (5.4) 

0 11 nn— 

1=1 n=l 
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where : 



K($) : Total amount of budget available 



: Number of Modules of Type i 

: Early warning system, type n 



c ,c.,d^; The cost coefficients of aircraft, module 
° ^ type i, and n^^ early warning system 

respectively 

N ; Number of different types of early warning 
systems available to purchase. 

b. Annual Budget Constraint 

The annual budget considered, for this study, 
is the annual maintenance budget. This is represented by 
considering the annual running cost of the maintenance 
facilities (e.g., annual salaries of repairmen). 

Therefore, the planned annual budget must be 
equal to or exceed the summation of the products of the 
number of repairmen (or crews) assigned to Shop i times 
their individual annual salary (or cost). Thus we obtain: 



i=l 



r .R. 
1 1 



< K 



1 



where : 



K, = Total annual budget planned for maintaining 

^ WS 

R. = Total number of Repairmen to be assigned 

^ to Shop i 
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r. = The annual salary for an individual repair- 
man assigned to Shop i. 

3 . Operational Constraints 

In order for the interceptor squadron to conduct 
training programs and reconnaissance missions during non- 
combat periods, and to be able to cause some damage to enemy 
bombers during combat periods, the number of aircraft, a, 
must have a positive lower bound. The lower bound of a, 
should be at least 2 aircraft so that some training missions 
can be conducted. However, the solution strategy for our 

models allows different values of I which can be determined 

a 

by the decision maker. Therefore, we obtain the following 
condition; 



a > 5, (5.6) 

““ 3 . 

similarly, lower bounds for i = 1,2, ...,I, can 

be derived. In order for the event of having all of the 
aircraft assigned to the squadron operational, to occur, 
we must have the following condition: 

M^^a i=l,2,...,I (5.7) 

Since the modules are assumed to be repairable, then 
every shop should be assigned at least one repairman (or 
crew) . Of course our model implies that the probability of 
having at least one idle repairman at Shop i is one if . 

Hence we obtain the obvious constraint: 
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1 < R. 

— 1 



1 “* 1 ^ 2 ^*** f 



I 



(5.8) 



< M. 
— 1 



In a more detailed model several crews or individuals might 
work simultaneously. 

Modules that are operational, and not installed 
on any aircraft, are stored in the supply depot. This results 
in a capacity constraint; for planning purposes, this can 
be represented by the decision maker specifying a certain 
coefficient, p^, for determining the ratio of modules of 
Type i to aircraft, where: 

£ p^a then p^ e [1,°°) 



Considering (5.7), it follows that, 

a < M. < p.a i = !,...,! (5.9) 

It is assumed that only one early warning system 
is to be purchased for the air defense system. This can 
be represented by the following constraint: 

N 

Ye = 1 , and E is binary, n = 1,...,N (5.10) 

^ , n n 



Finally the WS , WS*, that maximizes the objective 
function and satisfies the constraints is the solution of 
the following non-linear-integer-mathematical-programming 
problem. 
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niax I (DO) 

WS j = 0 cr(Bo,t) 



= j} 



s . t . 



N 



c„a 

0 



+ y c.M. + y d E < 

>1 11 ^ , n n — 

1=1 n=l 



K 



i=l 



r .R. 
1 1 



1 ^^1 



N 



1 E 



n=l 



n 



= 1 



a > i 

— a 

a < £ p^a i = 1, . . . , I 

binary n = 

a, , R^, i = are positive integers 



In general models that integrate logistics with 
combat will be referred to as combat-logistics (CL) models. 
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H. COMBAT LOGISTICS MODELS: SIMPLE ILLUSTRATIONS 

Suppose there are two early warning systems, E^^ and E 2 , 
available for purchasing. Each system can allow a different 
combat duration. The term "combat duration," referred to 
in this chapter, is the length of time required for the 
bombers to reach their bomb release line, measured from 
the beginning of the engagement. 

Let tj^ be the combat period achieved by deploying E^^ , 
and t 2 be the combat period achieved by deploying E 2 ; tj^ 
and t 2 are assumed to be deterministic. 

Special cases of the above combat-logistics model are 
the Single-Module Combat-Logistics (IMCL) and the Two- 
Module Combat Logistics (2MCL) models. 

1 . Single-Module Combat-Logistics Model (IMCL) 

Under the single-module logistics assiamptions , 
stated in Chapter II, the corresponding combat model becomes 

IMCL: max 7 f } P { D ( 0 ) = j) 

WS j=0 

S . t . 

c^a + cM + + ^ 2 E 2 ^ K 

^1 ^2 ^ ^ 

a > £ 

— a 

a £ M £ pa 

^1' ^2 ^ positive integers. 
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Note in the present IMCL formulation we may drop 
the annual budget constraint for the repairmen. This is 
because it is assumed that there is only one shop. There- 
fore, the number of repairmen, R, to be assigned to the 
repairshop will be: 




where r = annual salary for an individual repairman, since 
the above salaries are the only component of annual cost 
in the present model . 

The maximization is thus over the specification of 
WS , where we abbreviate the latter as 

WS = [a, M, E^] 

i.e., WS is represented by a vector whose components are 
the number of aircraft, a, the number of spare modules, M, 
and the particular warning system selected, . If = 1 
then the first early warning system is selected, otherwise 
Ej^ = 0 which indicates that the second early warning system 
is selected. 

Availability of aircraft is a nondecreasing function 
of the number of modules purchased for a given number of 
aircraft. That is, if the squadron has a number, a, of 
aircraft then procuring more modules will tend not to decrease 
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the availability of aircraft. The above, and constraints 
of IMCL, justify the following, for a given value of a: 



let M 




IMCL can be solved’ iteratively over all feasible 



values of a, E^, and E2 ; while choosing M to be as given 
above . 

2 . Two-Module Combat-Logistics Model ( 2 MCL) 

Under the two-module Igistics assumptions, stated 
in Chapter II, the corresponding combat model becomes: 



a 




2 MCL ; max ^ ${ 

WS j = 0 



s . t . 



Cpa + c^M^ + C2M2 + + <^ 2^2 — ^ 




< K 



1 




1 



a > £ 



a 



a £ M^ £ p^a 



a _< M2 _< P2^ 



1 < R 



1 



< M 



1 



1 < R 



2 



< M 



2 



E^, E2 binary; a, M^ , M2, Rj^ , R2 are positive integers. 
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In this case, WS is specified by the vector 



WS = [a, M2, R2/ 



In the k-module , s-shop case the WS is specified by 
an analogous vector. 

As in the case of the IMCL, for a given a and , 
it is assumed that the availability of aircraft is a non- 
decreasing function of M2- Also, for a given a, , M2, and 
Rj^ , we assume that the availability of aircraft is a non- 
decreasing function of R2 • Therefore for a given value of 
a, Mj^ and , let 



M 



2 = min{p2a. 



K-diEi-d2E2-Coa-diMi 



} , 



and let 



R, 



min {M2 , 



Ki-riRi 



2 MCL can now be solved iteratively over all feasible 
values of a, M^ , , E2 and R^^ , while choosing M2 and R2 

as given above. 



I. SPECIFIC ILLUSTRATIONS 
1 . General 

This section presents illustrations of some scenarios 
that can be modelled by IMCL, and 2 MCL. The scenarios 
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considered in this section are the BCD, and the I combat 
models, under the total surprise situation. Vie first pre- 
sent two illustrations of the IMCL model . one uses the I 
model for the combat part of the model, and the other uses 
the BCD model. Then, we present an illustration of the 2MCL 
model that uses the I combat model. 

The diffusion models constructed in Chapter IV are 
used to approximate the combat process under both the I and 
BCD models. The single-module logistics model, and the 
two-module logistics model, constructed in Chapter II are 
used to represent the logistics system required for WS . 

2 . Model Parameters : IMCL 



The following parameters are used for model 
illustrations : 

(i) Threat . The threat considered is B(C') = 12 
bombers attacking simultaneously. We have not 
taken into account the possible uncertainty in 
identifying the threat magnitude. 

(ii) MQE . The decision maker is interested in mini- 
mizing the probability of more than 3 bombers 
penetrating, or reaching their bomb-release line. 

(iii) Logistics . Each aircraft fails at a rate of 
A = 0.5 aircraft per day. 

There are R = 4 repair crews assigned to the 
squadron . 

Each failed module is repaired at rate y = 1.0 
modules per day, where only one repair crew 
can work on a failed module. 

- There is enough space to store modules when 
they are up and not installed on aircraft; 
i.e., p is assumed to be 

(iv) Combat . Each defender takes an exponential amount 
of time, with rate of = 3 (bombers per hour) , 
to kill a bomber, where only one defender can 
engage a free bomber. 
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For the I model the defenders are invulnerable, 

i . e . , Ug = 0 . ^ 

For the BCD model, C takes an exponential amount 
of time, with rate 9 = O.b to detect and engage 
a free bomber. Each bomber, if engaged, takes 
an exponential amount of time with rate = 0.5 
(defenders per hour), to kill a defender. 

If early warning system Ej_ is deployed then the 
combat period is t]_ = 1.0 hour. If F .2 is 
deployed then the combat period is t 2 = 0.8 hour. 
The lower bound for the number of aircraft, 
is 2. 

(v) Cost . 

The squadron has been allocated a budget of 
K = $115 million for purchasing the WS . 

Each aircraft costs Cq = $10 million. 

Each module costs c = $2 million. 

The E]_ costs d]_ = $15 million, while E 2 costs 
d 2 = $5 million. 

Using the above parameters, the IMCL becomes: 



a 

max J 
WS j = 0 



s . t . 



<J>{ 



z-y (12 , j , t) 
a (12 , j , t) 



}P{D(0) 



j} 



10a + 2M + 15E^ + 5E^ £ 115 



a - M 



El + E2 



1 



> 0 



a £ 2 

E^ binary i = 1,2 
a, M integer. 



WS. 



This model was solved by evaluating all feasible 
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Let 



t = + t2 (1 - E^) 

Then, if E^ is deployed then E^ = 1 and t = t^^ , 

otherwise E 2 is deployed and t = t 2 since E^ = 0. For every 

2 

j, p(12,j,t) and a (12,j,t) are determined using Result 

(4.3) for the I model and Result (4.2) for the BCD model; 

2 

where p ( ) and a ( ) are the mean function and the variance 
function of the {B(t); t ^ 0} process obtained by the diffu- 
sion approximations. 

3. IMCL Using I Model 

Under the I model assumptions, the diffusion 
approximation for B(t) is given by Result (4.3). 

For every combination of a and M, P{D(Q) = j} was 
computed using equation (2.8). 

Figure (5.1) shows a surface plot of the objective 
function when E^ = 1 . The figure indicates that if E^ 
is selected as the early warning system to be deployed, 
then the optimal WS = [6, 20, 1], i.e., to buy 6 aircraft, 
and 20 modules, this yields an objective value of 0.9903; 
i.e., a probability of penetration = 1 - 0.9903 = 0.0097. 

Figure (5.2) shows a surface plot of the objective 
function when E 2 = 1, which indicates that the optimal 
solution will be to buy 7 aircraft and 20 modules, and 
obtain an objective value of .9211. 
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Fiqure 5.2. Surface Plot of the Objective Function for 
Scenario with E, Deployed: Using SMCL(l) 



From the above, it is concluded that the optimal 
weapon system, WS*, is: 

WS* = [6, 20, 1] 

i.e., buy 6 aircraft, 20 modules, and deploy . WS* 
under the single-module logistics and the I-combat assump- 
tions results in a probability of penetration of 0.0097. 
a. Comparison with Exact Computations 

If a = 6 aircraft and M = 20 modules, then we 
get the following readiness distribution, using (4.8): 

j =01 2 3 4 5 6 

P{D(0) = j} = 0 0.0002 0.0006 0.0017 0.0034 0.0054 0.9887 

If we calculate P{B(1) ^ 3 |b( 0) = 12,D(0) = j}, 
j = 0,1,...,6, using the Markovian combat model, i.e., by 
solving the forward Chapman-Kolmogorov equations (4.58) 
numerically, we obtain the following: 

j = 0123456 

P{B(1) < 3| 

B(0) = 12,D(0) = j = 0 0.0004 0.1527 0.5444 0.7989 0.9590 0.9892 

Therefore : 

6 

I P{B(1) ^ 3lB(0) = 12,D(0) = j}P{D(0) = j} = 0.9870 

j = 0 
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It follows that by solving the Chapman-Kolmogorov 
equations numerically for WS* proposed by IMCL, we obtain 
a probability of penetration of 0.0120. This yields a 
relative error of: 



.0097 - .0120 

.012 



0.19 , 



i.e., a relative error of about 20% is obtained. This indi- 
cates that the diffusion is overly optimistic . But, the 
order of magnitude seems adequate, even though the numbers 
are small. 

4 . IMCL Using BCD Model 

When the BCD combat model was used with the param- 
eters given earlier (i.e., = 3, = .5, 0 = .6), IMCL 

gave: WS* = 17 15 IJ ; with an objective value of 0.5288, 

i.e., probability of penetration = 0.4712. If early warning 
system E 2 , which has shorter detection range than Ej^, 
is procured the corresponding optimal WS = [7 20 0] , 

with an objective value of 0.4686. This shows that, for 
the current example, procuring E^^ results in a better 
combat effectiveness than procuring more modules. 

Procurement of WS* = [7 15 1] yields a relatively 
high probability of penetration when compared with the I model 
case. This is due to introducing the combat parameters 

and 0. Table (5.1) shows the probability of penetration 

ID 

for decreasing values of a^, and increasing values of 0. 
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TABLE 5.1 



BEHAVIOR OF PROBABILITY OF PENETRATION PROVIDED 

BY IMCL AS 0 INCREASES, AND ^ 0 

B 



Probability of 

0 a_ Penetration 



.6 


. 5 


.47 


.6 


.2 


.41 


. 6 


.1 


. 38 


.6 


.05 


.36 


.6 


.005 


. 35 


. 65 


.005 


. 32 


.8 


.005 


.24 


. 85 


. 005 


.20 


.95 


.00005 


.15 


.95 


0 


.15 


.99 


0 


.13 


2 


0 


.03 



We find the probability of penetration decreases as 
decreases and 0 increases. 

It is evident from Table (5.1) that the MOE improves 
as 0 increases and/or a„ decreases. In particular the MOE 
tends to approach the value provided by the IMCL using the I 
model (i.e. , . 01) . 

a. Comparison with Simulation Results 

From equation (4.8), we obtain the following 
readiness distribution for a squadron of 7 aircraft that has 
15 modules, and 4 repair crews where the single-module 
logistics are assumed: 
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j 01234567 

P{D(0) = j} = 0.0002 0.0014 0.0056 0.0149 0.0298 0.0478 0.0637 0.8366 

Since is deployed the combat duration 
is 1 hour. Therefore the MOE has to be evaluated at t = 1. 
Simulating the Markovian combat process {B (t) ,C ( t) , D (t) ; 
t > 0} for 10,000 replications; where = 0.5 and 9 = 0.6 and 
collecting statistics at t = 1, we obtain the following 
values for P{B(1) £ 3 |b( 0) = 12,D(0) = j}, j = 0,1,.. .,7: 
j =01234567 

P B(l) £ 3 |b(0) = 12, 

D(0) = j} = 0.0 0.0 0.0 0.01 0.09 0.32 0.59 0.80 

The simulation-of-combat calculation gives 

7 

I P{B(t) < 3 |b( 0). = 12,D(0) = j}P{D(0) = j} = .72 

j=0 

i.e., probabil j", ty of penetration = .28. 

Recall that IMCL gave a probability of penetra- 
tion value of 0.47 which yields a relative error of about 
67%. This indicates (as anticipated in Chapter IV) that 
the diffusion is very conservative , but is of the correct 
order of magnitude. However, the relative error drops as 
B(0) + D(0) Nevertheless, the use of diffusion provides 

insights, and simple interpretation analysis of the problem 
without an excessive computational burden. Such insights may 
then be used for more detailed investigations if required. 
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Analysis such as Table (5.1) suggests that sensi- 
tivity analysis can be carried out easily on the combat- 
logistics model, by changing logistics and/or combat parameters, 
and re-solving the resulting model. The computational bur-- 
dens of re-solving are not at all excessive, in part because 
the calculation of leakage probability is facilitated by 
the diffusion approximations. 

Note that the leakage obtained under optimal 

3 

logistics assignment appear excessive, unless the C capa- 
bility, measured by 0, can be improved, or perhaps the early 
warning, and hence combat time, be extended. As an example 
of the type of analysis that can be carried out by the use 
of the CL model, a training program is analyzed below, 
b. Training 

Suppose the decision maker would like to inves- 
tigate the effect of adopting a certain training program 
for the pilots . Suppose that implementation of the new 
training program results in improvement of pilots ' combat 
and firing skills. Such improvement could be represented 
through an increase in the combat parameter a^. Suppose that 
if the new training program is adopted, then the defender 
killing rate increases from = 3.0 to = 4.0 bombers per 

hour. 

Assume that aircraft are required to be operated 
at a higher rate (i.e., no simulators) if the program is 
adopted. The effect of the training program on the logistics 
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system can be represented through the failure rate A. Sup- 
pose that the training program causes the failure rate to 
increase from A = 0.5 to A' = 1.0. 

The effect of the new training program on the 
overall squadron performance can be evaluated by the use of 
CL. The new parameters were considered by the IMCL model, 
which gave the following values: WS* = t7 15 IJ with an 

objective value of 0.398, i.e., a probability of leakage 
of 0.602 . 

Comparing the results before and after the 
implementation of the training program, we find that even 
though the training program results in an improvement in 
the skills of the pilots (represented by the higher killing 
rate) , it has a considerable effect on the logistics system 
which in turn increased the probability of leakage (.4712 
before implementation versus .602 after implementation). 

5 . 2MCL Using I Model 

The following parameters are used as an illustration 
for the 2MCL model using the I model . 
a. Cost 

The squadron has been allocated a budget of K = $75 
million for purchasing WS . 

Each aircraft costs Cq = $10 million. 

- Each module of Type 1 costs c^ = $2 million. 

Each module of Type 2 costs ~ million. 

Ej^ costs = $10 million, while E 2 costs = $5 
million . 
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A repairman for Type 1 has an annual salary of 

r]^ = $20 thousand, and a repairman for Type 2 is paid 

and annual salary of r 2 = $10 thousand. 

The squadron has an annual budget for salaries of 
K]_ = $80 thousand for repairmen. 

b. Logistics 

Each aircraft fails at a rate of A = 0.5 aircraft 
per day. 

Condition probability of an aircraft failing due to 
Type 1 module is pj = 0.4. 

Conditional probability of an aircraft failing due to 
Type 2 module is P 2 = 0.5. 

Conditional probability of an aircraft failing due 
to both types of modules is pi2 “ 0.1. 

An individual failed module of Type 1, or Type 2, 
has, respectively, a repair rate yg = 0.5, or \i2 ~ 1*0, 
modules per day, where only one repairman (or crew) 
can work on a failed module at any time. 

= 2 and P 2 = 2. 

c . Combat Data 

Each defender kills at a rate of = 3.0 bombers per 
hour . 

If El is deployed then the combat period is ti = 1.0 
hours, while if E 2 is deployed then the combat period 
is t 2 = 0.8 hours. 

The 2MCL, in this case, becomes: 
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WS j=0 a^xz,],r; 



s . t . 



10a + 2M^ + M 2 + lOE^ + 5 E 2 £ 75 



2^1 + "2 



^2 



a £ M^ _< 2 a 



a £ M 2 £ 2 a 



1 £ Rl £ M^ 



1 £ R2 £ M2 



a > 2 



8 

1 



^ l '^2 

a, Mj^ , M 2 / Rj 3 nd R 2 are positive integers 



2MCL(1) is solved iteratively over all possible 

WS that satisfy the constraints. For every j, y(12,j,t) 

2 

and a (12,j,t) are determined using Result (4.3) of Chapter 
IV where t = + t 2 E 2 . For every WS , P{D(0) = j } is 

computed by solving the forward Chapman-Kolmogorov equation, 
using proposition (2.1). Table (5.2) shows the different 
WS ' s when E^ is deployed and the corresponding objective 
value. We find that if E^^ is deployed, then the optimal WS is 

WSj^ = [4,8,8,3,2,11 
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A 

2 

2 

2 

2 

2 

2 

2 

2 

2 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

A 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

5 

5 

5 



TABLE 5.2 



ILLUSTRATION OF 2MCL(1) FOR I 
SCENARIO WITH El DEPLOYED 



ws 

Ml M2 b?2 El 



OBJECT I VE 

value 



2 


4 


1 


4 


1 


0.0439 


2 


4 


o 

4. 


4 


1 


0.0487 


2 


4 


3 


2 


1 


0 .0485 


3 


4 


1 


4 


1 


C.0625 


3 


4 


2 


4 


1 


0.0830 


3 


4 


3 


2 


1 


0 .0836 


4 


4 


1 


4 


1 


0.0723 


4 


4 


2 


4 


1 


0 .0964 


4 


4 


3 


2 


1 


0.0994 


3 


6 


1 


6 


1 


0. 1399 


3 


6 


2 


4 


1 


0.1931 


3 


6 


3 


2 


1 


0. 1955 


4 


6 


1 


6 


1 


0. 1 33^ 


4 


6 


2 


4 


I 


0.3160 


4 


6 


3 


2 


1 


0.3323 


5 


6 


1 


6 


1 


0 .2070 


5 


6 


o 


4 


1 


0 .37^91 


5 


6 


3 


2 


1 


0.4147 


6 


6 


1 


6 


1 


0 .221 B 


6 


6 


2 


4 


1 


0.4162 


6 


6 


3 


2 


1 


0.4504 


4 


8 


1 


6 


1 


0.2036 


4 


8 


2 


4 


1 


0.3722 


4 


8 


3 


2 


1 


0.3961 


5 


8 


1 


6 


1 


0.2332 


5 


a 


2 


4 


1 


0.5027 


5 


e 


3 


2 


1 


0 .5695 


6 


8 


1 


6 


1 


C.2520 


6 


8 


2 


4 


1 


0.5 777 


6 


8 


3 


2 


1 


0 .6791 


7 


a 


1 


6 


1 


0 .2536 


7 


8 


2 


4 


1 


0 . 6265 


7 


3 


3 


2 


1 


0.7371 


P 


a 


1 


6 


1 


0.2619 


8 


a 


2 


4 


1 


0 .6603 


a 


a _ 


3 


2 


1 


0 .7706 


5 


5 


1 


c; 


1 


0 . 2269 


n 


5 


2 


4 


1 


0 . ^64<3 


5 


5 


3 


2 


1 


0.6100 
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I.e., buy 4 aircraft, 8 modules of Type 1, 8 modules of 
Type 2, assign 3 repairmen to Shop 1, and 2 repairmen to 
Shop 2, while the last component being 1 indicates the 
deployment of . Choosing WS^^, and assuming the 2 module 
logistics system together with the I scenario, results in an 
objective value of 0.7706. 

Table (5.3) shows the different WS ' s when E 2 
is deployed, and the corresponding objective value. We find 
that if E 2 is deployed, then the optimal WS is: 

WS,, = [4 8 8 3 2 OJ 

i.e., buy 4 aircraft, 8 modules of Type 1, 8 modules of 
Type 2, assign 3 repairmen to Shop 1, and 2 repairmen to 
Shop 2, where the last component being 0 indicat'es the 
deployment of E 2 . This yields an objective value of 0.4925. 

Since WS^^ results in a higher objective value 
than WS 2 ^ the optimal solution for 2MCL is: 

WS* = [4 8 8 3 2 1]; 

with leaking probability of 0.2192. I.e., 

= 4 

= 8 
= 8 
= 3 



M* 

M* 

2 



R* 
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TABLE 5.3 



ILLUSTRATION OF 2MCL(1) FOR I 
SCENARIO WITH E2 DEPLOYED 



A 


Ml 


M2 


WS 

R1 


R2 


E 1 


OBJECT I VE 

value 




2 


2 


4 


1 


4 


0 


0 . 0 1 1 0 


2 


2 


4 


2 


4 


0 


0.0122 


2 


2 


4 


3 


2 


0 


C.O 121 


2 


3 


4 


1 


4 


0 


0.0156 


2 


3 


4 


2 


4 


0 


0.0207 


2 


3 


4 


3 


2 


0 


0 .0209 


2 


4 


4 


1 


4 


0 


0.0182 


2 


4 


4 


2 


4 


0 


0 .0241 


2 


4 


4 


3 


2 


0 


0 .0249 


3 


3 


6 


1 


6 


0 


0.0614 


3 


3 


6 


2 


4 


0 


0 . CS48 


3 


3 


6 


3 


2 


0 


0 .0857 


3 


4 


6 


1 


6 


0 


0.0346 


3 


4 


6 


2 


4 


0 


0.1514 


3 


4 


6 


3 


2 


0 


0 . 1 590 


3 


5 


6 


1 


6 


0 


0 .0972 


3 


5 


6 


2 


4 


0 


0 . 1 856 


3 


5 


6 


3 


2 


0 


C .2043 


3 


6 


6 


1 


6 


0 


0.1045 


3 


6 


6 


2 


4 


0 


C .2057 


3 


6 


6 


3 


2 


0 


0 . 2239 


4 


4 


8 


1 


6 


0 


0 . 1 090 


4 


4 


8 


o 


4 


0 


0.2023 


4 


4 


8 


3 


2 


0 


0.2155 


4 


5 


8 


1 


6 


0 


0 . 1 295 


4 


o 


6 


2 


4 


0 


0.2964 


4 


5 


8 


3 


2 


0 


0.3401 


4 


6 


p 


1 


6 


0 


0 . 1 390 


4 


6 


a 


2 


4 


0 


0 .3534 


4 


6 


6 


3 


2 


0 


C.4231 


4 


7 


3 


1 


6- 


0 


0.1436 


4 


7 


a 


2 


4 


0 


0 .3991 


4 


7 


8 


3 


2 


0 


0.4671 


4 


p 


3 


1 


6 


0 


0.1459 


4 


8 


8 


2 


4 


0 


0.4142 


4 


8 


S 


3 


2 


0 


0 .492 5 


5 


5 


1 0 


1 


6 


0 


0.13^0 


5 


5 


1 0 


2 


4 


0 


0 . 3 1 €9 


5 


f> 


1 0 


3 


2 


0 


0.3 66 1 


5 


6 


3 


1 


6 


0 


0 . 1432 


5 


6 


3 


2 


4 


0 


0 .3^27 


5 


6 


B 


3 


2 


0 


C .4 766 


5 


7 


6 


1 


6 


0 


0 • 1 4 4* 4 


5 


7 


6 


4 . 


4 


0 


0.4113 


5 


7 


6 


3 


2 


0 


0.4^13 
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Solving the forward Chapman^Kolmogorov equations 
for the logistics model, we obtain the following readiness 
distribution : 

j =01234 

P{D(0) = j} = 0.0023 0.0143 0.0435 0.0879 0.8519 

Calculate P{B(1) £ 3 |b( 0) = 12,D(0) = j} for 
j = 0,1,. ..,4, using the Markovian combat model, i.e., by 
solving the resulting forward Chapman-Kolmogorov equations 
(4.59) numerically. This gives 

j =01234 

P{B(1) > 3|B(0) = 12, 

D(0) = j} = 0.0 0.0 0.15 0.54 0.79 

Therefore , 

4 

I p{B(l) £ 3|B(0) = 12,D(0) = j}P{D(0) = j} = 0.73 

j = 0 

i.e., a leakage probability of 0.27. 

Hence, the 2MCL solution is a reasonably good 
approximation for the Markovian formulation with 
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relative error 



.19 



I 0.27 - 0.22 I 

0.27 

6 . Other Cases: Sensitivity Analysis 

Substituting WS* in 2MCL, we obtain; 

10a* + 2M* + M* + lOE* + 5E* < 75 

2R* + R* =8 
M* = 2a* 

M* = 2a* 

Comparing the above equations for the optimal 
point with the set of constraints for 2MCL, we find that; 

1. and are at their upper bounds. 

2. The annual budget constraint is binding. 

3. The fixed budget constraint is not binding since 

75-lOa* + 2M| + + lOEj + 5E$ = 1, i.e., when 

a = 4 , increasing and M 2 for given R]^ and R 2 
results in improvement of the objective value, 

but and M 2 have reached their upper bound before 
the fixed budget constraint becomes binding. 

a. Case 1 

Suppose we increase the upper bound for M 2 , 
reflected by increasing to 2.5 (i.e., change in the 
right-hand-side) . The solution for the new 2MCL is shown 
in Table (5.4). The new optimal point becomes; 

WS* =[4 8 9 3 2 1] 
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TABLE 5.4 



ILLUSTRATION FOR THE EFFECT OF CHANGING THE 
RIGHT-HAND-SIDE OF 2MCL(1) FOR I SCENARIO 



wS 

A Ml M2 R1 R2 



OBJECT I VE 
El value 



2 


2 


D 


1 


5 


1 


0 *0442 


2 


2 


5 


2 


4 


1 


0 • 0491 


2 


2 


5 


3 


2 


1 


0 • 0490 


2 




5 


1 


5 


1 


0 • 0630 


2 


3 


5 


2 


4 


1 


0. 0839 


2 


3 


5 


3 


2 


1 


0.0850 


2 


4 


5 


1 


5 


1 


0.C735 


2 


4 


5 


2 


4 


1 


0 .0973 


2 


4 


5 


3 


2 


1 


0.1015 


3 


3 


7 


1 


6 


1 


0.1401 


3 


3 


7 


2 


4 


1 


0.1 936 


3 


3 


7 


3 


2 


1 


0 . 1 967 


3 


4 


7 


1 


6 


1 


0 . 1 844 


3 


4 


7 


2 


4 


1 


0 .3172 


3 


4 


7 


3 


2 


1 


0 . 3360 


3 


5 


7 


1 


6 


1 


0 .2033 


3 


5 


7 


2 


4 


1 


0.3810 


3 


5 


7 


3 


2 


1 


0.4210 


3 


6 


7 


1 


6 


1 


0.2223 


3 


6 


7 


2 


u 


1 


0.4186 


3 


6 


7 


3 


2 


1 


0 . 4532 


4 


4 


1 0 


1 


6 


1 


0 .2087 


4 


4 


1 0 


2 


4 


1 


0 . 3724 


4 


4 


1 0 


3 


2 


1 


0 .3979 


4 


5 


1 0 


1 


6 


1 


0 .2382 


4 


5 


1 0 


2 


4 


1 


0 . 5033 


4 


5 
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with an objective value of 0.7808. The budget constraint 
is now binding, and is at its upper bound while M 2 is 
not . 

b. Case 2 

Suppose we are interested in seeing the effect 
of changing the repair rate, i.e., change to 2.0 while 
P 2 is still 2.5. The solution for the resulting 2MCL is 
shown in Table (5.5) . The new optimal point is: 

WS* = [4 8 9 2 4 1] 

with an objective value of 0.8574. Note that increasing the 
repair rate in Shop 1 has resulted in a corresponding 
increase in the objective value, and caused the optimal 
number of repairmen to be assigned to Shop 1 drops from 3 
to 2 , and to Shop 2 to increase from 2 to 4 . 
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TABLE 5.5 



ILLUSTRATION FOR THE EFFECT OF CHANGING 
THE REPAIR RATE AT SHOP 1 OF 2MCL(1) 
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VI. SUMMARY AND CONCLUSION 



A. GENERAL REVIEW 

The objective of this research has been to construct and 
utilize analytical models for certain combat-logistics 
situations. Since combat outcome is often crucially 
influenced by a combatant's readiness, and readiness depends 
strongly upon the adequacy of logistics support, it is 
necessary to link an appropriate logistics model with one 
for combat to create a combat-logistics (CL) model. Use of 
such a combined model allows the effect of the organization 
and budgetary constraints of the logistics system upon 
combat outcome to be directly assessed and optimized. 

The particular situation considered in this dissertation 
has been that of a squadron of aircraft designated to defend 
a small areas against surprise attack by wave of bombers. 
Upon detection of the bombers, ready defenders are vectored 
towards them and engage them in combat. Combat outcome is 
summarized by a measure of bomber leakage through the combat 
zone. 

Both logistics and combat are conducted in environments 
of substantial random variability and the numbers on both 
sides are small. Consequently stochastic models have been 
developed for the logistics and combat phases of the 
scenario described, and these models have then been linked. 
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The linked CL model allows a decision maker to identify 
fixed resource (budget-constrained) allocations that 
effectively minimize a chosen measure of bomber leakage. 

In order to provide a usable analytical tool, i.e., a CL 
model that can provide practical, reasonable and useful 
numerical outputs with feasible computational resources, 
mathematical approximations have been invoked. Particularly 
is this so in the combat modelling area, where an essen- 
tially transient and multi-state situation must be modelled. 
Various approaches have been taken, but most emphasis has 
been given to a form of diffusion approximation. The 
quality of this approximation improves when opposing forces 
become large, but the approximation provides useful accurate 
inputs to a logistics system optimization stage that would 
otherwise be computationally prohibitive. 

This chapter reviews the models constructed for analyz- 
ing peacetime and wartime activities. It highlights the 
main results obtained, and it points out areas that require 
further research. 

B. PEACETIME (NON-COMBAT) ACTIVITIES 

1 . Single-Module Logistics Model 

The peacetime (prior-to-combat) part of the combat- 
logistics process was analyzed with logistics models in 
Chapters II and III. This was accomplished initially by 
representing a weapon system, i.e., a defending aircraft, 
subject to failures as a single module. For this single 
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module situation, a logistics model was developed to 
describe aircraft readiness as a function of the number of 
spare parts, number of aircraft, number of repair facilities 
and failure and repair rates. The limitation of the model 
is the representation of an entire aircraft as a single 
module. 

2 . Two-Module Logistics Model 

To overcome the limitation of the single-module 
formulation a model was developed for the case in which the 
aircraft consists of two modules both of which are required 
for the aircraft to be considered mission capable. The 
model allows for simultaneous failures of the two modules, 
permitting much greater operational realism in representing 
the logistics activities of an aircraft squadron. 

The model is a bivariate-continuous-time Markov 
process. The size of the corresponding infinitesimal 
generator is (M^+l) (M 2 +I) , which becomes very large for even 
moderate values of M^ and M 2 . In order to solve this 
problem, the matrix geometric approach was implemented. 

With this approach the infinitesimal generator of the 
process was constructed and the limiting distribution and 
the Laplace transforms for general initial conditions were 
determined. 

3 . Readiness 

In order to compute the probability distribution for 
the number of aircraft ready to engage in combat, the 
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surprise phenomenon of war was considered. In this study 
the element of surprise was classified as total or partial 
surprise. Under the total surprise scenario, the defender 
has no time to prepare for combat, and hence there is no 
opportunity to cause changes to the logistics process. 

Under the scenario of partial surprise, the defender is 
assumed to have an exponential amount of time to prepare for 
combat. The combat preparation phase was modelled by 
decreasing the failure rate of an individual aircraft, and 
increasing the repair rate of an individual repairman. 

Hence, a new logistics process is introduced. This new 
process uses the limiting distribution of the old logistics 
process as an initial condition. The probability 
distribution of the number of aircraft ready to engage in 
combat at time of attack is then computed by solving a 
linear system of equations for the Laplace transforms. The 
cases studied indicate the degree with which readiness is 
improved when there is a warning time (i.e., partial 
surprise) . This evaluation can be used to estimate the 
effect of an improved intelligence system on aircraft 
squadron performance. 

4 . Repairman Allocation Model 

The problem of assigning repairmen (or crews) as a 
function of the state of the system was analyzed in Chapter 
III. Optimal assignment was determined by formulating the 
operational logistics system as a multivariate 
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discrete-state continuous-time Markov decision process. The 
optimal policy was then computed by applying dynamic 
programming and linear programming methods to the Markov 
decision process. In order to use Howard's (1976) solution 
algorithms for solving a univariate Markov decision process, 
a general one-to-one transformation function for mapping a 
multivariate state space on to a univariate state space was 
derived. This transformation facilitated solving the 
multivariate process as a univariate process using existing 
algorithms and theory. The results were then retransformed 
to the multivariate case for the final solution. 

5 . Further Research 

The logistics models presented in this thesis assume 
modules that are operational and not installed on an air- 
craft to be stored at a supply depot in a ready-to-install 
status. When an aircraft lands with a failed module, 
replacement is carried out instantaneously if there is a 
module of the same type in the supply depot. This assump- 
tion may be relaxed by introducing a random module replace- 
ment time. 

The models studied in this research assume that the 
repair shop is capable of conducting all types of repair. A 
multi-echelon repair system with base and depot repair may 
be considered explicitly by introducing a random delay 
during which time a module is diagnosed as repairable at the 
base with probability B , or requires depot repair with 
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probability 1-3. See Sherbrooke (1968), Muckstadt (1973), 
Hillestad (1982) , and Homesby (1985) . 

Other distributions can be assumed for the warning 
time. Gaver (1966) examined a class of densities that is 
convenient for representing warning times and presented a 
method for obtaining an approximate inverse of the Laplace 
transform. This provides some generalization in modelling 
surprise and the effect of an improved intelligence system. 
This is an area that merits further research. The results 
presented in Chapter II show that the element of surprise 
plays a major role in providing a link between the logistics 
and combat processes through its impact on the initial 
conditions of the combat process. 

The repairmen allocation model assumes neither cost 
nor time involved in assigning/reassigning repairmen to 
shops. The assumption of no elapsed time required to 
reassign repairmen to shops may be relaxed by introducing a 
"state of transition" for repairmen. If a repairman in one 
shop is reassigned to another, then the repairman experi- 
ences a delay (is said to be in limbo) for an exponential 
amount of time. One can also include costs in the repairman 
assignment problem. Two straightforward ways to do this 
are : 

(i) Introduce another objective function. The model 

then has two objective functions. One is to maxi- 
mize the long run expected number of aircraft ready 
to engage. The second is to minimize the long run 
expected cost. The model can then be solved as a 
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multiple-objective Markov decision process; see 
Viswanathan, Aggarwal and Nair (1977) . 

(ii) Add a new constraint which indicates that the long 
run cost must not exceed a certain bound. The 
resulting model can then be solved for different 
values of the bound. A plot of the objective value 
(i.e., the expected number of aircraft operational) 
versus the long run expected cost can then be 
constructed. 



C. WARTIME (COMBAT) ACTIVITIES 

Analytical models for representing air-to-air combat 
were studied in Chapter IV. The major areas are summarized 
below. 

1 . The Finite-Re-Enqaoement Rate Combat Model (the BCD 

Models 

The BCD model assumes that defenders are vulnerable 
and spend some time searching for a free enemy bomber. Once 
a free bomber is detected, it is then engaged by a free 
defender until either one of them is killed. If the bomber 
is killed, the defender once again searches for a free 
bomber; if a bomber wins, or is never engaged in combat, it 
may leak through the combat zone and attack the area 
defended. 

The combat process under the BCD scenario was 
initially modelled deterministically by a system of differ- 
ential equations. The deterministic model provides repre- 
sentation of the number of free bombers, bombers (hence 
defenders) in combat, and free defenders as a function of 
time. A simple criteria for defenders/bombers to win was 
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obtained in case combat time available is unlimited. An 
equation that predicts (approximately) the expected number 
of defenders/bombers surviving was presented. 

The deterministic model was then generalized by a 
diffusion model. The use of diffusion theory allowed us to 
represent some combat measures of effectiveness in near 
closed form mathematical equations. This, in turn, simpli- 
fied the linking of the combat models to the logistics 
models . 

A trivariate-continuous-time discrete-state Markov 
model (in particular a trivariate pure death process) was 
developed to represent the BCD combat process. A method for 
computing the Laplace transforms of the time-state proba- 
bilities was presented. The Markov process was simulated to 
check the results of the diffusion model. It was found that 
the diffusion results provided good approximations to the 
Markov process. 

The diffusion results were found to produce an 
approximation to the expected number of aircraft alive at 
time t that was identical to that provided by the deter- 
ministic models. In addition, the diffusion results provide 
an approximation for the variance-covariance matrix. Thus, 
probability statements can be evaluated by using the normal 
approximation . 

The dimension of the system of differential equa- 
tions resulting from the diffusion approximations is not a 
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function of the initial size of the forces. This allows 
military analysts to model economically combat processes for 
larger size problems. It also allows military analysts to 
derive expressions for approximating probability statements 
that represent measure of effectiveness and to compute their 
values without expenditure of excessive computer time. 

2 . The Infinite Re-Enaaaement Rate. I Model 

The I model assumes that defenders are invulnerable, 
and once a bomber is killed a free defender engages a free 
bomber, if any, instantaneously. The combat process was 
modelled deterministically by a differential equation. The 
equation was solved to provide an expression that approxi- 
mates the expected number of bombers alive as a function of 
time . 

The deterministic model was then generalized by 
developing a diffusion model. Expressions that represent 
the mean and variance of the number of bombers alive at time 
t was derived. It was found that the deterministic and the 
diffusion models gave the same representation of the mean. 

A simple univariate pure death model was developed 
to represent the I combat process. It was found that the 
diffusion results provided good approximation to the pure 
death model. An expression for the expected number of 
bombers alive as a function of time was derived. 

To allow more refined approximate calculations to be 
made for the I model, the large deviations method was 
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applied. A large deviations equation was derived to 
approximate the probability of at least z bombers alive at 
time t for relatively large values of t. It was found that 
the large deviations technique resulted in a better 
approximation for the measure of effectiveness than did the 
diffusion approximations. As yet there is no known way of 
applying large deviations to the BCD model. Hence the 
diffusion approximation has been used in the logistics 
optimization phase of the problem. 

3 . Further Research 

The application of the large deviations method to 
multivariate stochastic combat models appears to be a ripe 
area for further research. 

Diffusion models were used to generalize the deter- 
ministic models for air-to-air combat. It would be useful 
to develop similar models to generalize (approximate) the 
deterministic (Markovian) models for other types of combat 
(e.g., land, sea, ground-to-air, etc.). See Appendix B for 
a generalization of Lanchester's linear law; there it is 
shown that the diffusion mathematics recovers Lanchester's 
linear law and provides in addition a representation for the 
variance-covariance matrix of the approximating multivariate 
Gaussian process. 

D. COMBAT-LOGISTICS MODEL 

Chapter V was devoted to linking the analytical 
logistics models with the diffusion models of combat to 
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produce a combat-logistics model. The combat-logistics 
model is a non-linear-integer-mathematical programming 
model. That model determines the optimal number of 
aircraft, modules, and the type of early warning system to 
be procured, given fixed budgetary constraints. In 
addition, the optimal number of repairmen to be recruited 
(employed) is determined. The solution minimizes the proba- 
bility of penetration of enemy bombers subject to budget, 
operational, and capacity constraints on the defenders. 

1 . Further Research 

Further work remains to be done. The combat- 
logistics model described in this thesis allows a decision 
maker to evaluate the outcome of air-to-air combat, and 
hence provides the initial distribution of the number of 
bombers to be engaged by SAM forces. Ah analytical model 
for the ground-to-air combat, that can be grafted onto the 
proposed combat-logistics model, is also needed. A 
generalization to the combat-logistics model that allows for 
repeated enemy attacks over a short period of time is also 
needed . 

E. CONCLUSION 

The research presented in this thesis represents an 
effort to develop analytical models which can be used to 
assist decision makers in making some of the complex logis- 
tics decisions having an impact on combat effectiveness. 
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This work represents the first known effort to integrate the 
logistics and combat processes analytically. 

Combat-logistics models of the type illustrated here 
appear to have much to recommend them. Making decisions 
under a peacetime environment that can considerably affect 
combat outcomes is a complex task. The use of combat- 
logistics models similar to those presented here can assist 
the decision maker in answering "what if" questions 
interactively without expenditure of excessive computer 
time. The models can also be used to assist the planner in 
determining the effects of implementing new policies, cuts 
(or increases) in the annual maintenance budget, reductions 
in the number of modules, increases in the number of 
aircraft, improvement of the intelligence system, modifica- 
tion of the early warning system, or improvement in the 
communication, command and control system. 
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APPENDIX A 



NUMERICAL STUDIES IN LARGE DEVIATIONS 



A. GENERAL 

This appendix is designed to analyze the large deviations 
technique for evaluating probabilities at large values. The 
analysis includes: Deriving the large deviations equation; 

comparing it with actual values and with central limit theorem 
(CLT) results; and performing error analysis for the entire 
range of the independent variable. 

The idea of the large deviations technique is to displace 
the distribution of the random variable toward the value of 
interest, which is situated in the tail of the distribution. 
Applying the Normal approximation to the displaced distribu- 
tion gives a new, better approximation to the actual proba- 
bility (Feller, 1971). 

The appendix applies the large deviations technique to 
the compound Poisson process and renewal processes. 

An approach to reduce the large deviations error is 
introduced by shifting the value of interest with a prescribed 
interval. This approach is fully illustrated for the com- 
pound Poisson process. 

B. LARGE DEVIATIONS CONCEPT 

Suppose , Y 2 / . . . , are independent and identically 
distributed random variables with a common distribution 
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2 

o , then the normalized 



F{")/ such that E [Yj^] = 0 and E[Y^] 



sum ( I Y, )/(a/n) has the "n" fold distribution F . By 
k=l ^ 

the CLT, Fj^ tends to the standard normal (cEi). 

For large x, ${x) is close to unity, which indicates 
that for very large values of x, the CLT becomes empty. To 
overcome this problem, the large deviations (LD) technique 
was suggested by Esscher (1932). Also see Fe3 ler (1971); for 
a recent application of the technique see Mazundar and Gaver 
(1984) . 

We now derive the LD equation for P{X > z}, where X is 
either a fixed or a randomized sum of i.i.d. random variables. 

Let F (x) be the probability distribution function for X, 

X 



and F (s) is the corresponding moment generating function; 
X 



then 



F^(s) = / e^’^ Fj^{du] s > 0 



CO 



(A-1) 



— oo 



Let V be the probability distribution associated with 



F^ ( * ) / with mean y and 
X 



2 

variance a . Then: 



V{dx } 



SX ^ r J -I 

e F^ldx} 

X 



(A- 2) 
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/V 



Let V(5) be the moment generating function of V. Then: 



V(C) = / V{dx} 

— 00 

Substituting (A-2) and (A-1) , we obtain: 

F (s+C) 

V(C) = (A-3) 

Fx(s) 

If K(^) is the cumulant generating function for V, then, 

K(U = £n V(C) 

It follows that, 

U(s) = K’(0) 

and 

a^(s) = K"(0) . 

2 

Note that p and a are functions of s, i.e., there is a 
family of associated distributions for ( * ) . 

Let y(s) = z (i.e., center the associated distribution at 
the point of interest), and solve for s. Let s be the value 
of s such that p(s) = z. Thus, a unique associated distribu- 
tion V has been determined, i.e.: 
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V{dx} 



F^{dx} 

Fx(s) 



with ; 



mean = y (s) = z , 



and 



variance 



2 



a 



( s) . 



Thus , 



F^Cdx} 



1 . e. , 



F^ls) 



e"®^ V{dx} 



1 - F^iz) 



F^Cs) / V{dx} 

z 



By the normal approximation: 



CO ~ ■ (x-y (s) 

1 - Fx(z) - ^^(s) / e e 2a(s) . 

^ /2¥ z o(s) 

By standard substitution, and after completing the square, 
we get: 
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s 2 



l-Fj^(z) 



^ ^ 1 ~ ~ 2 
^ ~ -sy(s)+-^ (s) , « -^-(to+so (s) ) 

F„(s)e ^ / e ^ dto 

/2tt 0 



Considering the transformation x = co +so(s), we obtain 



l-F^(z) 



- ~ i2 2 ~ 

^ ^ -sy(s)+^jKj (s) , <» v^/o 

F^(s)e 2 -i- f, . e-^ dx 



X 



/ 2 ^ so (s ) 



Hence ^ the LD equation is: 



l-F^(z 



- Fj^(s)e 



. i2 2 . 
-sy(s)+-^ (s) 



[l-$(so(s) )] 



(A-4) 



where : 



Fx(s) 

y (s) 
(s) 



moment generating function of X 
mean of V = z 
variance of v. 



The above equation is the LD equation with parameters 
^ ~ ~ 2 ~ 

{F^ (s) , y (s) , o (s)}. The claim in this appendix is that any 
probability value computed for a point that is far in the 
tail using equation (A-4) will result in a better approxima- 
tion for the actual probability than CLT. 

Numerical studies were conducted to compare the CLT to 
the LD approximations. This is done according to: 

The length of the interval on the real line over 
which better results were achieved. 
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The variation in the relative error over the range of 
the independent variable. 

The behavior of each approximation at both relatively 
small and large values. 

C. LARGE-DEVIATIONS APPLICATIONS 

1 . An Application To Compound Poisson Process 

Let {N(t) ; t ^ 0} be a Poisson process with mean At, 
and {Y^, i = 1,2,...} be a family of i.i.d. random variables 
with distribution ( * ) ; where N(t) and are assumed to 
be independent. Define, 

0 if N(t) = 0 

] N(t) 

I y Y. if N(t) > 0 

^ i=l ^ 




It follows that X(t) is a compound Poisson process, with 
distribution ^x(t)^’^’ 

Suppose we are interested in evaluating P{X(t) > z} 
where z lies on the extreme right tail of the distribution. 

Let 4>y(s) be the moment generating function of Y^ , 

then : 






oo 

/ dFY{y} s > 0 

— OO 



/\ 

Let F ^ (s) be the moment generating function of X(t) . 
X ( t j 



Then : 



321 



N(t) 

si 

(s) = = E[E[e |N(t)]] 



= E[((()y(s)) 



N(t) 



] 



Hence , 



-At[l-(t> (s)] 

Fx(t) (s) = e s > 0 

To shift the distribution F(*) to the right, we 
associate with it the new probability distribution V(-)/ 
such that 



F , , {dx} 

V{dx} = — s > 0 

^X(t) 



Let V(C) be the moment generating function for V 
Therefore V(C) is given by (A-3); substituting (A-5) we 
obtain : 



At[({) (s+C)- 4 >y(s)] 

V(C) = e s>0, C>0 



The cumulant generating function becomes: 
K(C) = At(4)Y(s+a - 4 >y(s)) 



(A-5) 



(A- 6) 



(• ) . 



(A-7) 



(A-8) 
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Differentiating (A- 8 ) with respect to and setting 
5 = 0 , we obtain the following expression for the mean of v: 

y (s) = A t (J)^ (s) 



Differentiating (A- 8 ) twice with respect to and 
setting 5 = 0 , we obtain the following expression for the 
variance of V: 



(s) = At • (t>Y (s) 

Let s = s(z): z = At c{)y(s(z)), i.e., let s be the 

value of s that centers the distribution at the point of 
interest. It follows that: 

y(s) = At(t>Y(s) = z (A-9) 



and 



0^(s) = At4)^(s) . 

From (A-5) , we also obtain: 



^X(t) 



(s) 



-At [l-^Y (s) ] 
e 



Substituting (A-9)-(A-ll) into (A-4) , we obtain: 



(A-10) 



(A-11) 
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(A-12) 



-2 

-Xt [l-4> (s) +s4> ' (s) -^4) " (s) ] 
p{X(t) > z} - e ^ ^ 2 ^ 

X [1 - 0 ( s TXt'^^TsT ) ] 

2 . Example 

Suppose i = 1,2,...} is a family of independent 

exponentially distributed random variables with mean y 
Recall that N(t) is a Poisson process with mean At. 
a. Computing Actual Probability 

Let t)e the density function for X(t). 

Then : 



^X(t) 



(X) 



I P{N(t) = n} f^ 
n=l 



where : 



f^ is the Gamma distribution with parameter (n,y) 



X CO ia-/T,.\n / xU-l 

= { y ue~^^ dx 

„ S n: ^ (n-1) ! 



^x(t) 



0 n=l 



N(t) > 0 



P{X(t) =0} = P{N(t) = 0} = e 



-At 
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Hence : 



-At 



X = 0 






°° n-1 , ,i 

y _ y ^-yx (yx) -* 

L _ j L 



n=l 



) X > 0 



j = 0 



b. Computing Probability Using the Central Limit 
Theorem 



E[X(t)] = E[N(t)].E[Y] = ^ 



Var(X(t)) = E[N(t)]-E[Y ] = 



At (4 + 4) 

■y y 



2At 



Hence 



C.L.T. 



P{X(t) > 2) 



1 - 4 I ^ I . 

l/y(/2At) 1 



c. Computing Probability Using Large Deviations 



The moment generating function for i = 1,2, 



is given by: 



= ■= 



From (A-9) we get: 



z = At 



(y-s ) 
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It follows that: 



But s < 



Hence : 



P{X(t) > 



where : 



s = y ± / (Xty ) /z , 



y, therefore we obtain: 



s = y - /(Xty)/z 



z} 



-Xt [l-cf)^ 



^ ^ ^ ~2 
(s)+s0^(s)-^4>y(s)J 



X u - $(s/xt<})^(s) ) } 



s = y - / (Xty ) /z 






y -s 



<Py(s) 









(y-s) 

2y 

(y-s) 



a. Data 



The following data are used to compare CLT and LD 
to the actual probabilities of the compound Poisson process: 



{N(t) ; t ^ 0} is a Poisson process with mean At, where 
A = 1,2,3, and 4 . 

{Yj_; i = 1,2,...} is a family of i.i.d. exponential 
random variables with rate y = 1, 0.5, 0.33, and 0.25. 

The precision used for calculating the actual proba- 
bility value is 0.1 xl0“6. 

The probabilities were evaluated at "z" values ranging 
from 1.0 up to where the actual probability 

of being greater than Zj^ax less than 0.1 xio~®. 

The error for both CLT and LD is defined as: 



Relative error 



Actual Probability - Estimated Probability 
Actual Probability 



D. RESULTS ANALYSIS 

Figure (A. 1) shows the intervals of z over which the CLT, 
or the LD, gives better approximation. The figure shows 16 
cases where z was chosen such that it is greater than the 
mean of the compound Poisson process. The figure shows that 
the LD technique yields better approximation for larger 
intervals than the CLT approximation. 

Figure (A. 2) shows the variation of the error with 
respect to z values for the first four cases, i.e., A = 1.0, 
and y = 1.0, 0.5, 0.33, and 0.25. The four cases show that 
errors tend to behave in a similar way. It is evident from 
the figure that CLT tends to lose accuracy very rapidly for 
values of z that are not very far from the mean value. On 
the other hand, it seems that the LD approximation is improv- 
ing in accuracy as the value of z increases. The figure 
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X =1 y 
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:Cote : 



■■ Error C.L.T. < Error L.D. 

{ — 1 Error L.D. < Error C.L.T. 

z-dorrain is considered greater 
than tile mean of the Corpound Prcess 



Figure A.l. Error Comparison in Z-donain: Compound 

Poisson Process 
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CASE 1 ; EXP(1) CASE 2 : EXP(.5) 
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Fiqure A. 2. Error Analysis — Compound P.P. (Poisson(D) 



shows that the worst accuracy the LD gives is at relatively 
small values of z; the error is relatively small when com- 
pared with the maximum error the CLT generates at relatively 
high values of z, which in all of the cases studied was found 
to converge to 100% error. 

Figure (A. 3) illustrates the actual probabilities versus 
CLT and LD approximations (in logarithmic scale) for the 
above four cases. The plots show that generally the LD 
results in a good approximation, especially for large z values, 
and it always overestimates the actual probability (at least 
for the cases examined so far) . The deviation from the actual 
probability tends to decrease as z increases. The figure 
indicates that LD error tends to decrease as y increases. 

To get a better understanding on the behavior of both 
approximations, case (4) (i.e., X = 1.0, and y = 0.25) was 

studied. Figure (A. 4) illustrates the comparison between 
the actual, CLT, and LD probabilities at small z values. 

The figure indicates that CLT results in a better approxima- 
tion than the LD technique. 

Figure (A. 5) illustrates the comparison between the 
actual, CLT, and LD at relatively large values of z for case 
4. The plot supports the previous conclusion that LD gives a 
good approximation for the actual probability at large values 
of z . 

1 . An Application to a Renewal Process 

Let {N(t), t ^ 0 } be a renewal process. Suppose we 
are interested in evaluating P{N(t) < z} for large values of 
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CASE 1: EXP(1) CASE 2: EXP(.5) 
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Figure A. 3. Actual Prob. vs. C.L.T. and L. Dev. Prob., Corapound 
Poisson Process Poisson (1) 




> 



N 
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Figure A. 4. Case 4: Coir.parison at Small Values of 
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Figure A. 5. Case 4: Comparison at Large Values of 



t. Define X(n) to be the waiting time for the n^'^ renewal. 
The event {N(t) < z} is equivalent to the event {X(z) > t}. 

Hence, we are interested in evaluating P{X(z) > t}. 

Let be the time between the n^^ and (n+l)®^ event, 
and n = 1,2,...} is a family of i.i.d. random variables 

with distribution F{*). Therefore: 

z 

P{X(z) > t} = P{ ^ Y. > t} 

i=l ^ 

where t lies in the extreme right tail of the distribution. 
Let 



()) (s) = E[e®^] = / e®^ dF{y} 



Let 



^ / \ ^ r sX(n) , 



It follows that. 



^X(n) ^ s > 0 



(A-13) 



Define : 



F (n) {dx} 

V { dx } = s > 0 , 

^X(n)(") 
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The moment generating function is given by: 



V(C) 



^X(n) ^ 



s > 0 , C > 0 



Substituting (A-13) , we obtain: 

^ (j) (s+5) z 

V(C) = ( ^ ) 

4>y(s) 

The cumulant generating function becomes: 



(A-14) 



K(?) = z{iln((J)Y(s+C) ) - £n((})Y(s) ) } 



(A-15) 



Dif ferentiaing (A-15) with respect to and at ^ = 0 , we 
obtain : 



VI ( s) 



z 4>^(s) 



s > 0 



Differentiating (A-15) twice with respect to and at ^ = 0 , 
we get: 



(s) 



Z (})^ ( S ) c})^ ( S ) - Z ( (f)^ ( s ) ) 



> 0 



Let 



s (t) : 



z <^Y ^ s ) 

4>y (s) 



(A-16) 
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i.e., s is the value of s that centers the associated dis- 
tribution at the point t. 

From (A-4), the LD equation for the renewal process 

becomes ; 



- 1-2 2 ~ 

“St+yS o (s) - ^ 

P{N(t) < z} - (4 >y(s)) e {1 -4>(so(s))} (A-17) 

where : 

~ ~ ~ 2 
2 ^ Z(f)Y (s) (f)^ (s) - z(4)^(s)) 

o (s) = :: 2 ' 

((()y(s) ) 

and s is given by (A-16) . 

The application of the CLT to the renewal process 
is given by the following theorem (Ross, 1983): 

Theorem: 

2 

Let y and o , assumed finite, represent the mean and 
variance of an interarrival time. Then, 



P 



N(t) -t/y y 

“477 



-> 



1 /2 

- j e dx as t -> oo 

/ 27 T -oo 



where {N(t), t ^ 0} is a renewal process. I.e., N(t) is 
asymptotically normally distributed as t -> <». 
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E. TOWARDS A BETTER APPROXIMATION FOR LARGE DEVIATIONS 

Although the LD yields a better approximation to the 
actual probability values, a more detailed research work was 
done towards improving the approximation. This work is based 
on investigating the skewness of the associated distribution 
V. The experiments done for the compound Poisson process indi- 
cates that the skewness value for the associated distribution 
is generally positive, i.e., it is skewed to the right. This 
led to carrying out some numerical studies to determine the 
effect of shifting the mean of the associated distribution an 
amount A . 

Equation (A-9) becomes: 



z + A 



At 



(A-18) 



Using (A-5) and (A-6), we obtain: 



P{X(t) > z} 



-At [1-4)^ (s) ] 



/ e ^^V{dx} . 



oo 



e 



z 



By the Normal approximation: 



(x-At4^(i))^ 



P{X(t) > z} 



-At[l-4^(s)] 





dx 



e 



/At4^(s) 
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By standard substitution (considering (A-18), we obtain: 



P{X(t) > z} - 



-At[l-cf)^(s)] , CO 

® -hi 

/Tu -A 



-s (At4)^ (s) Wxt4)^ (s) 
e du 



At4-;;(s) 



Completing the squares, we obtain: 



P{X(t) > z} - e 



-At[l-(|)^(i)+s(})^{s)-^<i)^(s)J ^ 



C» -^(03+sAt<l)" (s) ) 

X / e 2 ^ da, 

-A 



At4)"(s) 



Considering the transformation x = a,+s/At(j)y (s) , we obtain: 



-At[l-* (s)+s4>' (s)-%4::(s)] . , 

p{X(t) > z} - e ^ {<1 ( - s At(|)" (s 

At4),^(s) 



The following algorithm was used for computing A*, where 
the minimum relative error is achieved: 

1. Set Aj^ = 0 , k = 1. 

2. Set the mean of the associated distribution, y{s) =z +A^,. 

3. Compute P{X(t) > z}, (actual and LD) for the compound 
Poisson process. Evaluate the relative error e^^, and the 
skewness coefficient C^,, where: 
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and 



_ [Actual - LD I 
k Actual 



K'» ( 0 ) 
0^ (s) 



4. If > e^_^) stop. A* = k > 1, 

Else , 



A 

k 



k+1 



k+1. 



A, + Increment 
k 

go to 3 . 



F. DELTA-TECHNIQUE: RESULTS ANALYSIS 



Implementing the proposed technique leads to a better 
approximation to the actual probability values. For example, 
it was found that for the case of A = 1, and y = 1 , the maxi- 
mum relative error for z values greater than the mean of the 
compound Poisson process is .0006. 

The numerical studies done indicate that the large devia- 
tion using the delta approach gives better approximation over 
the entire range of z-domain, even in the intervals where the 
CLT previously gave better approximations, i.e., for relatively 
small z values. 

The numerical studies also indicate that as A increases, 
both the skewness coefficient and the relative error tend to 
decrease for a fixed z value. This continues until A*, where 
the relative error starts to increase, while the skewness 
coefficient continues to decrease. All cases studied indicate 
that A* is reached before the skewness coefficient reaches 
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the value of zero. This observation leads to the conclusion 
that the best associated distribution doesn't necessarily 
have to be syminetric. 

Figure (A. 6) shows the values of A* for a given value 
of z for 16 cases (y = 1, .5, .33, .25; and X= 1, 2, 3, 4). 

The figure points out an interesting feature: The value of 

A* can be chosen to be a fixed value for each y. These average 
A* values are: 



If 


1 — 1 
II 

r-H r— 

1 1 


the 


If 


y = 2 

-1 


the 


If 


y = 3 

-1 


the 


If 


y -^ = 4 


the 



average A* = 2.2 
average A* = 4.4 
average A* = 6.6 
average A* = 8.8 



Note that average A* = 2.2(y ^) , and it is independent of 
X. Applying this criterion for determining A to all of the 
16 cases resulted in a maximum relative error of .08 over the 
entire range of z. The proposed approach (i.e.. A* = 2.2 (y ^)), 
in addition to providing better approximations than the CLT over 
the entire domain, gives a simple algorithm to follow. On 
the other hand, if a better approximation is required, then 
some work has to be invested in constructing a table that 
indicates the value of A for every z for various rate values. 
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EXP(0 EXP(.5) 
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Figure A. 6. Analysis of Optimum Delta Values 



APPENDIX B 



LANCHESTER'S LINEAR LAW: A GENERALIZATION 



A. GENERAL 

This appendix is designed to generalize Lanchester ' s - 
linear law (LLL) . Let B(t) and D(t) be the surviving com- 
batants at time t in the attacker and defender forces, 
respectively. Assume B(0) = B, and D(0) = D. 

Let a_ (a^) be the rate at which an individual defender 
D r> 

(attacker) kills an individual attacker (defender) . 

Define the following functions: 

• b(t), an approximate representation of the number of 
attackers alive at time t, given the number of 
attackers and defenders entering combat initially. 

• d(t), an approximate representation of the number of 
defenders alive at time t, given the number of 
attackers and defenders entering combat initially. 

B. DETERMINISTIC MODEL: LLL MODEL 

Assume that the attrition rates are proportional to the 
number of targets as well as the number of firers. The 
combat process can be modelled deterministically (LLL; see 
Taylor (1983)) by the following system of differential 
equations : 



db(t) 

dt 



b (t) d (t ) 



(B.l) 



dd(t) 

dt 



ttg b (t) d (t) 
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v/ith initial conditions: 



b(0) = B(0) 

d(0) = D(0) 

The first equation of (B.l) represents the rate of change 
of b(t) as a function of time. The expression states that 
the rate of change of the attackers depends on the number 
of attackers and defenders alive at time t. The expected 
decrease in b(t) caused by a defender killing an attacker is 
represented by the term aj^b(t)d(t). A similar argument is used 
to write the second expression of (B.l). 

Before presenting the solution for (B.l), we carry out 
a similar analysis as for the BCD scenario presented in Chap- 
ter IV. From (B.l) , we get: 



db(t) 

“b 



a 



dd (t) 



D dt 



(B.2) 



Integrating both sides of (B.2), we obtain: 



ag[b(t) - b(0)J = ttj^[d(t) - d(0)] 



from the initial conditions, we get: 



ag[b(t) - B(0)J = aj^[d(t) - D(0)] Vt (B.3) 
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Criteria for Defenders to Win 



A rough criterion for defenders to win can now be obtained 
by assuming that in order to conclude that defenders won, 
we must have b(<») =0 and d (<») > 0. Under this assumption, 
and as t (B.3) becomes: 



Therefore, the condition for the defenders to win is to 
satisfy the following condition: 



Notice that equation (B.5) is the same as equation f(4.9) 
which gives the condition for the defenders to win in air- 
to-air combat under the BCD scenario. So the deterministic 
model for the LLL model, which is usually used to represent 
land combat, and the BCD model resulted in the same condition 
for the defenders to win (eventually) . This is due to the 
fact that the condition given by equation (4.9) (hence, (B.5)) 
is independent of the engagement rate 0, and also because of 
the fact that the product, b(t)d(t), in (4.1) and (B.l) can 
be replaced by any function with the same result. 




a^D(O) - agB(O) 



(B.4) 



Since a^, and d('») are all positive values, then: 



a^D(O) - agB(O) > 0 



a^D(O) > agB(O) 



(B.5) 
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The solution for equation (B.l) is given by Taylor (1983): 



b(t) = 



‘I 



C, ■ 

-aj^D exp [- (a^B -aj^D) t] ' 



B 



1 +a„Bt 



for ^ a B 

iJ B 



for = a^B 

u B 



(B. 6) 



and 






d(t) = 



{ D(0) I— =; 5 ~ r ' f — f; px . 1 ] for a_B 

I -a^B exp [-{aj^D -OgB)t] D B 



1 +aj^Dt 



for = OgB 



These equations permit easy numerical computation of b{t), 
and d(t), i.e., the representations for the number of combatants 
of both forces at various points in time during the combat 
period . 

C. DIFFUSION MODEL FOR THE LLL SCENARIO 

Following the arguments used in Chapter IV to derive 
the diffusion approximation for the BCD scenario, we can 
formulate the combat process under the LLL scenario as a 
diffusion process. 

Define the following: 

• B(t) to be a stochastic diffusion representation for 

the number of attackers alive at time t. 

* D(t) to be a diffusion representation for the number 

of defenders alive at time t. 
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• N to be the total number of combatants of both forces 

available for combat initially (i.e., N s B(0) + D(0)) 

We can characterize the land combat process approximately 
when N 00 (hence, B(0) + D(0) ->■ oo) , by treating {B(t),D(t); 
t ^ 0} as a bivariate diffusion process. We can model the 
state vector {B(t),D(t); t ^ 0} by writing it in the form 
of Ito stochastic differential equations as follows: 



dB(t) = -aj^B ( t ) D ( t) dt - /aj^B(t)D(t) dW(t) 



dD(t) = -a^B (t) D(t)dt + /a^B(t)D(t) dW(t) 

Jd o 



(B.7) 



where {W(t); t ^ 0} is a standard Wiener process. 
Consider the following transformation: 

B(t) = Nb(t) + /N Xj_(t) 

D(t) = Nd(t) + /n (t) 

Differentiating (B.8), we obtain: 



(B. 8) 



dB(t) = N db(t) + /N dXj_(t) 
dD(t) = N dd(t) + /N dX2(t) 



(B.9) 



where: b(t) and d(t) are deterministic functions of time, 

being approximations to the process means {X^(t); t ^ 0}, 
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i = 1,2, are stochastic elements, all of which need to be 



determined . 

Suppose that X^(0) = 


X2(0) = 0. Then we obtain. 


b(0) 

and 


= (B.IO) 


d(0) 


_ D(0) 

N 


Let = a_N and 

D D U 


= to be constants as N <»; i.e.. 



assume that and to be small enough such that a^N and 
a^N ^ constant as N -> <». This means that on the average a 
defender or an attacker takes a relatively long time to 
achieve a kill. 

Now, substituting (B.8) and (B.9) into (B.7), and isolat- 
ing terms of order N and /N, and letting N ^ we obtain 
the following sets of equations. 

1 . Deterministic Equations 

The terms of order N yield: 



db(t) _ 
dt 


- aj^b(t)d(t) 




(B.ll) 


dd(t) _ 
dt 


- agb(t)d(t) 



with initial conditions given by (B.IO). 
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Equations (B.ll) are equivalent to equation (B.l), 
which shows that the diffusion approximation for the LLL 
scenario results in the same approximations for the process 
means as the deterministic model. 

2 . Stochastic Equations 

The terms of order /N yield: 



dXj^(t) = -{apd(t)Xj^ (t) + apb(t)X2(t) dt - /ap5(t)d(t) dV7(t) 

(B.12) 

dX2(t) = -{ogd{t)X^(t) + agb(t)X2(t) dt + /agb{t)d{t) dW(t) 



Writing the above in a matrix form, we get: 



dX(t) = A(t)X(t)dt + V(t)dW(t) 



where : 



X(t) 



" X^(t) 



and 



V(t) 



■ -/aj^B(t)d(t) 

_ /5gb(t)d{t) - 
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and 



A(t) 



-apd(t) -a^b(t) 
-agd(t) -agb(t) 



Since X(0) = b(0) and d(0) are given by (B.IO). 

Then by appealing to the central limit theorem, for all t > 0, 
(t) ,X 2 (t) ; t ^ 0} has a bivariate normal distribution 
with mean ^ and covariance matrix Z (t) which satisfies the 
following differential equation (Arnold, 1974): 



it 



= A(t) Z (t) + Z (t) A (t) + 



V(t)v' (t) 



(B.13) 



Recall that 



— ‘ — 








_ — - 


B (t) 




b(t) 




Xj^(t) 




= N 




+ /N 




D(t) 




d(t) 




X2(t) 







— 




- 



Therefore, we have obtained the following: 

RESULT (B. 1) : 

{B(t),D(t)} is approximately bivariate normal 
(Gaussian) , as N h- oo (hence, B(0) and D(0) ^ simultaneously 
and in a fixed proportion) . 
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{B(t),D(t)} := Normal (N(b(t) ,d(t) ) ,NZ (t) ) 



By the required substitution and multiplication, we 



get ; 



V(t)V^ (t) 



a^b(t)d(t) -b(t)d(t)/o^ 



-b (t) d (t) agb(t)d(t) 



Writing : 



I (t) 



aii(t) 

0i2(t) 022(t) 



Equation (B.13) becomes: 



^ S(t) = G(t)S (t) + H(t) 



with initial conditions: 



S(^) = ^ 



where : 



S(t) = (t) 
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0 



G(t) 



-2aj^d(t) -2aj^b(t) 

-agd(t) - (Ogb (t) +Oj^d (t) -a^^bCt) 

0 -2agd(t) -2agb(t) 



and 



H{t) 



a^b (t) d (t) 
-b ( t ) d { t ) 

ttgb (t) d (t) 



D. LLL MARKOVIAN COMBAT MODEL 

Suppose an attacker takes an exponential amount of time 
with mean a ^ to kill a defender; and that a defender takes 
an exponential amount of time with mean to kill an attacker. 

Then the combat process can be represented by the bivariate- 
continuous-time discrete-state Markov process {B(t),D(t); 
t ^ 0} operating on the state space S = { (i,j) ; 0 < i+ j ; 
i = 0,1,.. ,,B; j = 0,1,,..,D}. 

The transition probabilities of the process {B(t),D(t); 
t > 0} of order dt are as follows: 



t t+dt 

(ifj) (i,j-l) 

(i-l,j) 
(i,j) 



Probability 
fg (i, j )dt + o (dt) 
f^(i,j)dt + o(dt) (B.14) 

1 - f(i,j)dt + o (dt) 
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where : 



fgU^j) = a^ij 
foUrj) = a^^ij 
f (i, j ) = fg (i, j ) + fg (i, j ) 



Let 



-.(t) = P{B(t) = i,D(t) = j|B(0) = m,D(0) = n} 

rnri ^ j_ j 

For simplicity of notation we will suppress the initial 
condition, and write: 






(t) = 



mn ; x j 



(t) 



Apparently {B(t),D(t); t ^ 0} as defined by (B.14) is 
a finite state bivariate death process. 

The forward Chapman-Kolmogorov equations are: 













= -f(B,j)Pg . (t) 


+ fB(b,j+l)PB_j^l(t) 11 j 1:^1 








+ fp(l+l,D)P.^^_B(t) 


(B.15 
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+ fp(l+l, . (t) 1 1 i 1 B-1 

1 < j < D-1 




D 



(l,j)PT .(t) 




fg(i,l)Pi^;L(t) 



1 £ j < D 



1 < i < B 



with initial condition; 



(B.15) 
(Cont ' d) 



i/D 



( 0 ) 



I 1 if (i, j ) = (B,D) 

I 0 otherwise 



Let P. . (s) be the Laplace transform for P. . 
^ / D 1 / D 



(t ) 



Then : 






P . . 

i/D 



(s) 



/ e P . . (t)dt s > 0 

0 ^ ^ 



We now take the Laplace transforms for (B.15) by follow- 
ing the procedure done for the BCD scenario; and using the 
initial condition we get: 
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f (B,D)+s 






j+l)PB^ j_^l(s) } 



1 < j < D-1 






1 < i < B-1 






£ij^£B(i,j+l)Pi,j^l(s) + fo(i+l,j)Pi^i,j(s)) 

1 1 3 1 B-1 
1 < j < CHl 



(B.16) 









1 < j < D 






1 < i < B 



Figure (B.l) shows a graph representation for the Markovian 
combat process. Equations (B.16) are in a form that is 
suitable for a recursive solution. 



^(s) is given in (B.16) . Now we can find P_ ^ , (s 

f U ID f JJ— ± 



and P , ,^(s) since they are functions of P only. The 

x3 ~ ^ U x3 f i-} 

P^ ^ , (s) and P„ , r^(s) are the only transforms needed to 
B f D” -L B~ X / D 

/\ /\ /\ 

find Pg ^B-1 D-1^®^' ^B-2 given by (B.16) 

Continuing this way, we find, as in the BCD Markovian model, 
that by knowing the Laplace transforms of the states in the 
n depth of the graph, the Laplace transforms for the (n+1) 
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depth 1 




Figure B.l. A Graph Representation of the LLL 
Combat Process 
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depth can be calculated for any value of s. Therefore, an 
algorithm similar to the algorithm used to solve (4.49) can 
now be constructed to solve (B.16); 



1. Construct the graph of the process as follows: 

For the nth depth, find the possible states and 
calculate its width, i.e., how many states are in 
the n^^ depth. Continue until the width of the 
depth is zero. 

"hH 

2. For the n depth, if the width = 0, stop. Else, 
pick a state (say (i,j)). Then: 

a. Calculate the mean of the corresponding sojourn 

time of the state (i.e., (f(i,j))“l). 

s t 

b. Examine all states in the (n-1) depth to deter- 
mine states that are accessible to state (i,j). 

c. Calculate the corresponding transition rates from 
the states determined in b. to state (i,j). 

d. Calculate the Laplace transform for (i,j). Repeat 
for all states in the n^h depth. 

The solutions for (B.16), i.e., the Laplace transforms, 
can be used to evaluate quantities of interest, such as: 



■n-j^(i) = P{i defenders eventually survive combat} 



Following the same arguments presented for the BCD model, 
it can be shown that: 





(B.17) 



and 



D 

E[B(«^)|B(0) = B,D(0) = D] = I jf (l,j)P, .(0) 

j=l ^ 



(B.18) 
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E. SIMULATION OF LLL MARKOVIAN SCENARIO 

Following the same arguments used for simulating the 
BCD scenario, we can simulate the LLL Markovian combat 
process . 

The Monte-Carlo simulation was constructed based on the 
following : 

a. The time spent by the process at state (i,j) is 
exponentially distributed with rate f(i,j). 

b. The transition probabilities for the embedded 
Markov chain, are as follows: 



Present 




Next 


Probability 


(i/ j ) 


-> 


(i,j-l) 


feCi/j) 
f (i,j) 






(i-l,j) 


fD(i/j) 
f (i/ j ) 



Generate and U 2 as in the BCD simulation. A realiza- 
tion of X. ., time spent in state (i,j) can be obtained by: 

1 / D 



- S,n U, 



X 



i,j f(i,j) 



(B. 20) 



After spending X. . units of time in state (i,j), the 
process will transit to: 



( i , j -1 ) if 0 < U 






2 - f(i,j) 



(B.21) 



(i-1/ j ) 



otherwise 
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Let {Bj^(nAt) ,Dj^(nAt) ; M = be a (the 

realization of the process {B(t),D(t)} at time nAt, and 
th 

during the m replication of the simulation model. 

Defining BB, BS , DD, and DS as in the BCD simulation, 
we can calculate the statistics by applying equations 
(4.85) and (4.86) . 

The following basic data were used as an example for 
model illustration. 

A threat of B(0) = 12 attackers engaging exactly D(0) 
defenders. Each defender and attacker is assumed to take 
an exponential amount of time with mean (Uj^) ^ = (.008) ^ 
minutes, and (a^) ^ = (.004) ^ minutes respectively, to kill 

JD 

an opponent. 

Suppose we are interested in evaluating P{B(t) > 3| 

B(0) = 12,D(0) = j} for j = 1,2,..., 20. FORTRAN programs 
were written for: 

1. Computing the stochastic mean, variance and proba- 
bility distribution for B(t) using the forward 
Chapman-Kolmogorov equations. 

2. Computing the approximate mean and variance using 
the diffusion approximation to compute the required 
probability. 

3. Simulating the Markov process to compute the stochas- 
tic mean, variance, and required probabilities. 

For illustration purposes the following values for D(0) 

were considered: 

D(0) = 3, 5, 10, 12, 16 and 20 
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Figure (B.2) shows a plot of the stochastic mean result- 
ing from the simulation model and the deterministic mean 
resulting from the diffusion model. It is clear from the 
plot that there exists a bias between the stochastic mean 
and the deterministic mean. The bias -> 0 as D(0) increases. 

It is also clear that the deterministic mean underestimates 
the stochastic mean. 

Figure (B.3) shows a plot for the variance function result- 
ing from simulation compared to the variance function result- 
ing from diffusion approximation, for the various values of 
D(0). We find that the variance of the diffusion tends to 
approach that provided by simulation as D(0) increases. 

Figures (B.2) and (B.3) show that the diffusion approximation 
model results in good approximation as D(0) increases. The 
example shows that for a relatively small value of D(0), 
e.g., D(0) = 16 and D(0) = 20, the diffusion approximation 
started to result in a good approximation. 

Since there exists bias in both of the mean and variance 
approximations, we therefore expect to have some difference 
between the actual probabilities for the Markov process and 
the probabilities resulting from applying the normal approxi- 
mation. To compare the different values for P{B(t) > 3] 
B(0),D(0)} a value of t = 20 minues was selected. 

Figure (B.4) shows a comparison of the actual values for 
p{B(t) > 3 1 B (0 ) , D (0 ) } , as a result of solving the forward 
Chapman-Kolmogorov equations numerically, to the normal 
approximation values with continuity correction using the 
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qxo) tt*<0) _ ‘tKO) 



KO) - 3 



0 ( 0 ) - 1 




0(0) - to 0(0) - t2 




Figure B.2. Deterministic Mean Versus the 

Stochastic Mean of B(t): lll Model 
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tXO) - J 



«o) - « 







0 ( 0 ) - 1 * 0 ( 0 ) . 20 





Figure B.3. Plots of the Variance Approximation Resulting 
from Diffusion Versus Variance from Simulation 
of B(t): LLL Scenario 
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diffusion approximation, and the probability resulting from 
the simulation model. We find that the simulation output 
represents the actual probability obtained by solving the 



Chapman-Kolmogorov equations. The diffusion 
a better approximation as D(0) ^ <». 

Figure (4.5) shows plots for the various 
between the probabilities which supports the 



tends to give 

differences 
above observation. 
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ACTUAl - NORMAL APPROV. SIMULATION - NORMAL APPROX. 
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Figure B.5. Differences of the Various Values of the 
Probabilities Shown in Figure 4.9 
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